Guest User

Untitled

a guest
Feb 23rd, 2018
66
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 1.12 KB | None | 0 0
  1. apiVersion: extensions/v1beta1
  2. kind: DaemonSet
  3. metadata:
  4. labels:
  5. app: spark-shuffle-service
  6. spark-version: 2.2.0
  7. name: shuffle
  8. spec:
  9. template:
  10. metadata:
  11. labels:
  12. app: spark-shuffle-service
  13. spark-version: 2.2.0
  14. spec:
  15. volumes:
  16. - name: temp-volume
  17. hostPath:
  18. path: '/tmp/spark-local' # change this path according to your cluster configuration.
  19. containers:
  20. - name: shuffle
  21. # This is an official image that is built
  22. # from the dockerfiles/shuffle directory
  23. # in the spark distribution.
  24. image: kubespark/spark-shuffle:v2.2.0-kubernetes-0.5.0
  25. imagePullPolicy: IfNotPresent
  26. volumeMounts:
  27. - mountPath: '/tmp/spark-local'
  28. name: temp-volume
  29. # more volumes can be mounted here.
  30. # The spark job must be configured to use these
  31. # mounts using the configuration:
  32. # spark.kubernetes.shuffle.dir=<mount-1>,<mount-2>,...
  33. resources:
  34. requests:
  35. cpu: "1"
  36. limits:
  37. cpu: "1"
Add Comment
Please, Sign In to add comment