https://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_develop_run.htmlhttps://m.blog.naver.com/PostView.nhn?blogId=estern&logNo=220824080406&proxyReferer=https%3A%2F%2Fwww.google.co.kr%2Fhttp://scala-ide.org/docs/tutorials/m2eclipse/http://jdm.kr/blog/176http://www.gooper.com/ss/bigdata/271691http://blog.naver.com/PostView.nhn?blogId=kimyoon21&logNo=220297814742&parentCategoryNo=&..

$ wget http://d3kbcqa49mib13.cloudfront.net/spark-2.1.0-bin-hadoop2.7.tgz$ tar xzvf spark-2.1.0-bin-hadoop2.7.tgz $ ./sbin/start-master.sh$ ./sbin/start-slave.sh spark://localhost:7077$ ./bin/pyspark –master spark://localhost:7077 $ wget https://downloads.lightbend.com/scala/2.12.3/scala-2.12.3.tgz$ tar xzvf scalar-2.12.3.tgz$ vi .bashrc export SCALA_HOME=/home/eduuser/scala-2.12.3export PATH=$P..

1. Zookeeper 설치 및 실행$ wget HYPERLINK "http://apache.mirror.cdnetworks.com/zookeeper/stable/zookeeper-3.4.10.tar.gz"http://apache.mirror.cdnetworks.com/zookeeper/stable/zookeeper-3.4.10.tar.gz $ tar xzvf zookeeper-3.4.10.tar.gz $ cd zookeeper-3.4.10$ cd conf$ cp zoo_sample.cfg zoo.cfg $ ./bin/zkServer.sh start 2. Storm 설치 및 실행$ wget HYPERLINK "http://apache.mirror.cdnetworks.com/storm/apache-stom..

$ sudo yum install mysql mysql-server$ sudo chkconfig mysqld on$ sudo service mysqld start$ sudo mysql_secure_installation $ vi /etc/my.cnf[mysqld]bind-address=127.0.0.1 $ wget HYPERLINK "http://apache.mirror.cdnetworks.com/hive/stable-2/apache-hive-2.1.1-bin.tar.gz"http://apache.mirror.cdnetworks.com/hive/stable-2/apache-hive-2.1.1-bin.tar.gz$ tar xzvf apache-hive-2.1.1-bin.tar.gz$ ln -s apache..

처음에는 AWS API Gateway와 Lambda를 같이 사용하려고 했으나, 마지막 연결하는 부분에 있어서 이해가 안되는 부분이 있어서 중단했다.http://how2marry.com/2016/06/21/%EC%84%9C%EB%B2%84%EB%A6%AC%EC%8A%A4-%EC%8D%B8%EB%84%A4%EC%9D%BC-%EC%83%9D%EC%84%B1-api-gateway-lambda-s3-cloudfront/ 그래서 AWS Lambda의 트리거를 이용하여, 새로운 이미지가 업로드 되면 무조건 썸네일 이미지를 생성하는 방식으로 진행하였고, 완성할 수 있었다. 일부 코드를 수정하기는 했지만, 앞의 방법보다는 빠르고 쉽게 만들 수 있다.https://medium.com/n42-corp/aws-lambda%E..

https://spark.apache.org/downloads.htmlDownload Spark: spark-2.2.0-bin-hadoop2.7.tgz Spark StandAlone 설치부터 예제 테스트까지.http://hellowuniverse.com/2017/03/08/spark-standalone-%EC%84%A4%EC%B9%98%EB%B6%80%ED%84%B0-%EC%98%88%EC%A0%9C-%ED%85%8C%EC%8A%A4%ED%8A%B8%EA%B9%8C%EC%A7%80/./sbin/start-master.sh./sbin/start-slave.sh spark://Hajiui-MacBook-Pro-2.local:7077 ./bin/pyspark --master spark://Hajiui-MacB..