nitowa
/
Distributed-Union-Find
Watch 1
Star 0
Fork 0
Code Issues 0 Pull Requests 0 Releases 0 Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
6 Commits
1 Branch
Tree: a614991ff0
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'a614991ff0'
${ noResults }
Distributed-Union-Find/start_services.sh

start_services.sh 592B
History Raw

123456789101112 
  1. SPARK_HOME=$(python3 -c 'import json,sys;config=json.load(open("./settings.json"));print(config["spark_home"])')

  2. SPARK_MASTER=$(python3 -c 'import json,sys;config=json.load(open("./settings.json"));print(config["spark_master"])')

  3. 

  4. echo "Starting spark master..."

  5. "$SPARK_HOME"/sbin/start-master.sh

  6. echo "Starting spark workers..."

  7. SPARK_WORKER_INSTANCES=5 "$SPARK_HOME"/sbin/start-worker.sh "$SPARK_MASTER"

  8. echo "Starting cassandra container..."

  9. docker run -d -p 9042:9042 cassandra

  10. echo "Starting spark history server..."

  11. mkdir -p /tmp/spark-events

  12. "$SPARK_HOME"/sbin/start-history-server.sh