Kepler Prime Mission Data Available on AWS

tl;dr The first four years of data obtained by the Kepler spacecraft are available as an Amazon Web Services (AWS) Public data set. In this post we describe which data products are available and how to use astroquery to obtain a light curve file from the s3 bucket.

Kepler observed parts of a 10 by 10 degree patch of sky near the constellation of Cygnus for four years (17, 3-month quarters) starting in 2009. The mission downloaded small sections of the sky at a 30-minute (long cadence) and a 1-minute (short cadence) in order to measure the variability of stars and find planets transiting these stars. These data are now available in the public s3://stpubdata/kepler/public S3 bucket on AWS.

These data are available under the same terms as the public dataset for Hubble and TESS, that is, if you compute against the data from the AWS US-East region, then data access is free.

Which data are available? How often will they be updated?

The following Kepler primary mission data products are available in this public bucket for all 17 quarters of Kepler: light curve files, target pixel files and full frame images. The Kepler mission data collection and reprocessing is complete so we do not expect any of these products to change. Other data products may be added if users express an interest in using them with AWS compute services.

A full list of the available data can be found in the manifest.txt.gz file which is available in the top level directory of the Kepler public data set (s3://stpubdata/kepler/public). To download the manifest file, run the following python code:

Be sure to have your .aws/credentials file in place with the access keys specified, otherwise access will be denied.

Example data access with astroquery observations

Astroquery supports data download from the Kepler public data bucket on S3. To do this you need to enable the cloud data set within the observations module of astroquery.mast. With this enabled, astroquery will attempt to pull the data from the cloud first. See the astroquery documentation for more information and be sure to upgrade your astroquery so it is using at least v0.4.dev0

This snippet of code locates a light curve file for Kepler-10 and then retrieves it from the AWS S3 bucket.

More Information

How do I get an AWS account? See the AWS account console.

How do I learn more about astroquery.mast? See the astroquery documentation.

How do I learn more about Kepler data? Go to the Kepler Home Page at MAST.


Post brought to you by Susan E. Mullally