Skip navigation to main content

AWS Glue Elastic Views Announced

With the recent announcement of AWS Glue Elastic Views at re:Invent 2020, our serverless AWS toolkit gets another addition that pushes the boundaries even more at how we can support working with the data we have captured in our AWS solutions to help meet business needs.

Introducing AWS Glue Elastic Views

With the recent announcement of AWS Glue Elastic Views at re:Invent 2020, our serverless AWS toolkit gets another addition that pushes the boundaries even further in how we can work with the data captured by our AWS solutions to help meet business needs.

AWS Glue Elastic Views is a new service that allows you to combine and replicate source data across multiple target data sources to create virtual tables (referred to as 'materialised views') via SQL.

The service will monitor your source data stores to ensure that the target data stores are kept up to date in near real-time. Without AWS Glue Elastic Views, this would be a complex task whereby you would need to orchestrate the replication yourself via robust scripting and custom processes.

What’s an example of how this could work in practice?

AWS Glue Elastic Views allows integration with Amazon Elasticsearch as a target data source.

You could replicate your business data from a source data store, such as Amazon DynamoDB, into Amazon Elasticsearch as a view. This would enable you to perform searches using Amazon Elasticsearch to meet your business needs.

If you use Amazon DynamoDB to store marketing data, for example, which was replicated to Elasticsearch as a view, Amazon Elasticsearch could then be used to run queries against it for insights - the Kibana Plugin will be very useful here as well. This certainly opens up a lot of possibilities to help you understand your data!

Which AWS technologies does AWS Glue Elastic Views integrate with?

Source data stores currently include Amazon Aurora, Amazon RDS and Amazon DynamoDB.

Target data stores where materialized views can be created include Amazon Redshift, Amazon Elasticsearch, Amazon S3, Amazon DynamoDB, Amazon Aurora and Amazon RDS.

How does the pricing model work?

AWS Glue Elastic Views has the cost benefits associated with being a serverless service so you will pay for the resources consumed for view processing and table storage as per the AWS pricing model for this service, rather than having the overhead of running servers to support this capability.

Additionally, charges may be incurred against the source and target data stores during processing. Hence, as with all serverless technologies, it’s important to understand any costs that will be generated prior to usage to help prevent anything unexpected appearing on your AWS bill!

Summary

Data is a key asset to any organisation and harnessing the capabilities of technologies like AWS Glue, and now also AWS Glue Elastic Views, can help organisations make sense of it all so they can drive forward their businesses in the most well-informed way possible.

As of the time of writing this blog AWS Glue Elastic Views is in preview - we are looking forward to evaluating it soon!