Apache Spark 1.5.0 released

Apache Spark 1.5.0 recently released, is the sixth release on the 1.x line. This release represents 1400+ patches from 230+ contributors and 80+ institutions. Apache Spark is a fast and general engine for large-scale data processing. Spark has an advanced DAG execution engine that supports cyclic data flow and in-memory computing and runs on Hadoop, Mesos, standalone, or in the cloud. It can access diverse data sources including HDFS, Cassandra, HBase, and S3.

HowTo setup S3Fox Plugin for Amazon S3 Bucket

S3Fox Organizer helps you organize, manage and store your files on Amazon S3 bucket. The user interface is clean and intuitive, has all the basic features you need and it works fast. It is easy to install and use as it is integrated into the browser. – Open Firefox browser on your machine and browse for s3fox. Click on “Add to Firefox” and click on “Install Now“ – Restart Firefox browser.

Install AWS on Windows to manage Amazon EC2 and S3

AWS is a command-line tool that gives you easy access to Amazon EC2 and Amazon S3 from the convenience of your desktop machine. Credit goes to Timothy Kay for developing this awesome tool. I have seen questions asked on how to manually copy files from a local machine to Amazon S3 buckets and possibility of automating the process. In this post I will focus on how to get things started by installing and configuring your machine for aws.

Make your Amazon S3 bucket publicly accessible

If you have files stored on Amazon S3 bucket and would like to make them accessible to the public, this article will guide you on how to achieve that. Its simple to do. Steps: – Log into your Amazon S3 console https://console.aws.amazon.com/s3/home → Right-click on desired bucket and click on Properties – In properties screen on right hand-side → Expand Permissions and click on ‘Add bucket policy’ – Enter the following code into the Bucket Policy Editor (You can use the AWS Policy Generator to create a custom policy base on choice) { "

How to create an Amazon S3 bucket

Amazon Simple Storage Service (Amazon S3) is an online storage facility. You can use Amazon S3 to store and retrieve any amount of data in the scale of magabytes to terabytes from anywhere in the world. The AWS Management Console is a simple and intuitive web interface you can use to manage your buckets. To create an Amazon S3 bucket, you need an AWS account. If you don’t already have one, you’ll be prompted to create one when you sign up for Amazon S3.