Trouble accessing Kubernetes endpoints

I’m bringing up Spark on Kubernetes according to this example:

For some reason, I’m having problems getting the master to listen on :7077 for connections from worker nodes. It appears that connections aren’t being proxied down from the service. If I bring the service up, then bring the master controller up with the $SPARK_MASTER_IP set to spark-master, it correctly resolves to the service IP but cannot bind the port. If I set the ip to localhost instead, it binds a local port and comes up -- since services should forward socket connections down to the pod endpoint this should be fine, so we move on.

  • Is it possible to configure Docker to pull from my GitHub repo?
  • How to connect to a SQL instance in an App Engine custom runtime Dockerfile?
  • Elastic Beanstalk docker error
  • Docker: using container with headless Selenium Chromedriver
  • How to start a stopped Docker container with a different command?
  • Is it possible to commit only a subset of the changes to a docker image?
  • Now I bring up workers. They attempt to connect to the service IP on :7077 and cannot. It seems as if connections to the service aren’t making it down to the endpoint. Except…

    I also have a webui service configured as in the example. If I connect to it with kubectl –proxy I can get down to the web service that’s served on :8080 from spark-master, by hitting it through the webui service. Yet the nearly identically-configured spark-master service on port 7077 gives no love. If I configure the master to bind a local IP, it comes up but doesn’t get connections from the service. If I configure it to bind through the service, the bind fails and it can’t come up at all.

    I’m running out of ideas as to why this might be happening -- any assistance is appreciated. I’m happy to furnish more debugging info on request.

  • Docker, what is it and what is the purpose
  • Spring Boot app with eureka server and docker
  • Import AMI image as Docker image
  • NginX as HTTPS reverse proxy for multiple sub-domains?
  • Why is it not possible to call locale-gen with sudo inside a docker container?
  • Can't kill supervisord inside of docker container
  • One Solution collect form web for “Trouble accessing Kubernetes endpoints”

    I’m sorry, the Spark example was broken, in multiple ways.

    The issue:

    It now works, as of 2/25/2016, and is passing our continuous testing, at least at HEAD (and the next Kubernetes 1.2 release).

    Note that DNS is required, though it is set up by default in a number of cloud provider implementations, including GCE and GKE.

    Docker will be the best open platform for developers and sysadmins to build, ship, and run distributed applications.