Amazon Athena

Bookmarks
Features
Partitioning
Queries
Security
Pricing
AWS Knowledge Center Videos: How do I analyze my S3 logs using Athena?
Validate Your Knowledge

An interactive query service that makes it easy to analyze data directly in S3 using standard SQL.

Features

Athena is serverless.
Has a built-in query editor.
Uses Presto, an open source, distributed SQL query engine optimized for low latency, ad hoc analysis of data.
Athena supports a wide variety of data formats such as CSV, JSON, ORC, Avro, or Parquet.
Athena automatically executes queries in parallel, so that you get query results in seconds, even on large datasets.
Athena uses Amazon S3 as its underlying data store, making your data highly available and durable.
Athena integrates with Amazon QuickSight for easy data visualization.

Athena integrates out-of-the-box with AWS Glue.

Athena uses a managed Data Catalog to store information and schemas about the databases and tables that you create for your data stored in S3.

Partitioning

By partitioning your data, you can restrict the amount of data scanned by each query, thus improving performance and reducing cost.
Athena leverages Hive for partitioning data.
You can partition your data by any key.

Queries

You can query geospatial data.
You can query different kinds of logs as your datasets.
Athena stores query results in S3.
Athena retains query history for 45 days.
Athena does not support user-defined functions, INSERT INTO statements, and stored procedures.
Athena supports both simple data types such as INTEGER, DOUBLE, VARCHAR and complex data types such as MAPS, ARRAY and STRUCT.
Athena supports querying data in Amazon S3 Requester Pays buckets.

Security

Control access to your data by using IAM policies, access control lists, and S3 bucket policies.
If the files in the target S3 bucket is encrypted, you can perform queries on the encrypted data itself.

Pricing

You pay only for the queries that you run. You are charged based on the amount of data scanned by each query.
You are not charged for failed queries.
You can get significant cost savings and performance gains by compressing, partitioning, or converting your data to a columnar format, because each of those operations reduces the amount of data that Athena needs to scan to execute a query.

AWS Knowledge Center Videos: How do I analyze my S3 logs using Athena?

Note: If you are studying for the AWS Certified Data Analytics Specialty exam, we highly recommend that you take our AWS Certified Data Analytics – Specialty Practice Exams and read our Data Analytics Specialty exam study guide.

Validate Your Knowledge

Question 1

A multinational corporation is using Amazon Athena to analyze the data sets stored in Amazon S3. The Data Analyst needs to implement a solution that will control the maximum amount of data scanned in the S3 bucket and ensure that if the query exceeded the limit, all the succeeding queries will be canceled.

Which of the following approach can be used to fulfill this requirement?

Set up a workload management (WLM) assignment rule in the primary workgroup.
Set data limits in the per query data usage control.
Integrate API Gateway with Amazon Athena. Configure an account-level throttling to control the queries in the S3 bucket.
Create an IAM policy that will throttle the data limits in the primary workgroup.

Show me the answer!

Correct Answer: 2

Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. You don’t even need to load your data into Athena, it works directly with data stored in S3. You can use Athena to run ad-hoc queries using ANSI SQL, without the need to aggregate or load the data into Athena. Amazon Athena can process unstructured, semi-structured, and structured data sets.

To fulfill the requirement in the given scenario, you must update the data limits in the primary workgroup. Take note that there are two types of cost controls in Amazon Athena:

– per-query limit

– per-workgroup limit

It is stated in the scenario that if the query in Athena exceeded the limit, all the succeeding queries will be canceled. Therefore, the type of cost control you need to use is the per-query limit or the per query data usage control. The per-query control limit specifies the total amount of data scanned per query. You can create only one per-query control limit in a workgroup, and it applies to each query that runs in it.

Hence, the correct answer is: Set data limits in the per query data usage control.

The option that says: Integrate API Gateway with Amazon Athena. Configure an account-level throttling to control the queries in the S3 bucket is incorrect because you can’t directly integrate API Gateway with Amazon Athena. In addition, the account-level throttling is only applicable in API Gateway. The most suitable solution is to set a per-query control limit to fulfill the given requirement in the scenario.

The option that says: Set up a workload management (WLM) assignment rule in the primary workgroup is incorrect because WLM is only available in Amazon Redshift and not in Amazon Athena.

The option that says: Create an IAM policy that will update the data limits in the primary workgroup is incorrect because you cannot use an IAM policy to set a data usage limit or cancel succeeding queries in Amazon Athena.

References:
https://docs.aws.amazon.com/athena/latest/ug/manage-queries-control-costs-with-workgroups.html
https://docs.aws.amazon.com/athena/latest/ug/control-limits.html
https://docs.aws.amazon.com/athena/latest/ug/workgroups-setting-control-limits-cloudwatch.html

Note: This question was extracted from our AWS Certified Data Analytics Specialty Practice Exams.

Question 2

A company is using Amazon Athena query with Amazon QuickSight to visualize the AWS CloudTrail logs. The Security Administrator created a custom Athena query that reads the CloudTrail logs and checks if there are IAM user accounts or credentials created in the past 29, 30 or 31 days (depending on the current month). However, the Administrator always gets an Insufficient Permissions error whenever she tries to run the query from Amazon QuickSight.

What is the MOST suitable solution that the Administrator should do to fix this issue?

Disable the Log File Integrity feature in AWS CloudTrail.

Enable Cross-Origin Resource Sharing (CORS) in the S3 bucket that is used by Athena.
Use the AWS Account Root User to run the Athena query from Amazon QuickSight.
Make sure that Amazon QuickSight can access the S3 buckets used by Athena.

Show me the answer!

Correct Answer: 4

Athena reads data from Amazon Simple Storage Service (Amazon S3) buckets using the AWS Identity and Access Management (IAM) credentials of the user who submitted the query. Query results are stored in a separate S3 bucket. Usually, an “Access Denied” error means that you don’t have permission to read the data in the bucket or permission to write to the results bucket.

You get an insufficient permissions error when you run a query and the permissions aren’t configured. To verify that you can connect Amazon QuickSight to Amazon Athena, check these settings:

AWS resource permissions inside of Amazon QuickSight
IAM (IAM) policies
Amazon S3 location
Query results location
AWS KMS key policy (for encrypted data sets only)

If you receive an “insufficient permissions” error, try these steps to resolve your problem:

Make sure that Amazon QuickSight can access the S3 buckets used by Athena.
If your data file is encrypted with an AWS KMS key, grant permissions to the Amazon QuickSight IAM role to decrypt the key. The easiest way to do this is to use the AWS CLI. You can run the create-grant command in AWS CLI to do this.

Hence, the correct answer is: Make sure that Amazon QuickSight can access the S3 buckets used by Athena.

The option that says: Disable the Log File Integrity feature in AWS CloudTrail is incorrect because this feature simply determines whether a log file was modified, deleted, or unchanged after CloudTrail delivered it. This is not a probable root cause of getting an insufficient permissions error.

The option that says: Enable Cross-Origin Resource Sharing (CORS) in the S3 bucket that is used by Athena is incorrect because cross-origin resource sharing (CORS) simply defines a way for client web applications that are loaded in one domain to interact with resources in a different domain.

The option that says: Use the AWS Account Root User to run the Athena query from Amazon QuickSight is incorrect because this violates the best practice of granting the least privilege. It is actually a security risk to use the root IAM user of your account since it has the full permissions to all AWS services. It is recommended not to use the root user.

References:
https://docs.aws.amazon.com/quicksight/latest/user/troubleshoot-athena-insufficient-permissions.html
https://docs.aws.amazon.com/quicksight/latest/user/troubleshoot-connect-athena.html
https://aws.amazon.com/blogs/big-data/analyzing-amazon-athena-usage-by-teams-within-a-real-estate-company/

Note: This question was extracted from our AWS Certified Security Specialty Practice Exams.

For more AWS practice exam questions with detailed explanations, visit the Tutorials Dojo Portal: