Spark Docker – Can't access web UI for resource manager – Mac PC

Can’t access resource manager web ui – Spark docker container – Mac PC

These are the steps that I did:

  • Application doesn't receive SIGTERM in Docker
  • Cannot connect to the MongoDB server from node by using the environmental system variables set in Docker
  • Vagrant - Docker provider vs. docker provisioner
  • Can't connect to a supevisor-socket in Nginx
  • Getting “netcoreapp1.0” is an unsupported framework during Docker build
  • Using Ansible docker_service module to deploy service to swarm
  • docker pull sequenceiq/spark:1.6.0

    docker run -it -p 8088:8088 -p 8042:8042 -p 4040:4040 -h sandbox sequenceiq/spark:1.6.0 bash

    I tested using this: ( Runs fine )

    run the spark shell

    spark-shell \
    –master yarn-client \
    –driver-memory 1g \
    –executor-memory 1g \
    –executor-cores 1

    execute the the following command which should return 1000

    scala> sc.parallelize(1 to 1000).count()

    But can’t access the web ui:

    I tried:

    a. :8088

    b: http://sandbox:8088/proxy/application_1458858022274_0002/A

    c: localhost:8088

    Nothing works.. Any help ??

    Thanks in advance!!

  • Why can't I use Docker CMD multiple times to run multiple services?
  • Upgrade docker-compose to version 3
  • Accessing enviroment variables from a linked container
  • Docker: readonly filesystem error
  • Build docker ubuntu image by Dockerfile
  • Docker build/push every time - is it practical for continuous deployment?
  • One Solution collect form web for “Spark Docker – Can't access web UI for resource manager – Mac PC”

    You need to expose the ports before publishing them. Either EXPOSE 8088 8042 4040 in the Dockerfile or -e 8088 -e 8042 -e 4040 in your run command. Expose functionality is separated from publish/host mapping functionality because there are cases where one would like to expose to port to other containers without mapping it to the host.

    Docker will be the best open platform for developers and sysadmins to build, ship, and run distributed applications.