Cloud Dataprep by Trifacta is an intelligent data service for visually exploring, cleaning, and preparing structured and unstructured data for analysis, reporting, and machine learning. Features You can transform structured or unstructured datasets of any size — megabytes to petabytes — with equal ease and simplicity. Cloud Dataproc can transform datasets stored in CSV, JSON, or relational table formats. You can process data stored in Cloud Storage, BigQuery, or from your desktop, then export the refined data to BigQuery or Cloud Storage for storage, analysis, visualization, or machine learning. Uses a proprietary algorithm that interprets the data transformation intent of [...]
About SenseiThis author has not yet filled in any details.
So far Sensei has created 355 blog entries.
Bookmarks Features Loading data into BigQuery Querying from external data sources Monitoring Pricing Validate Your Knowledge Google Cloud BigQuery A fully managed data warehouse where you can feed petabyte-scale data sets and run SQL-like queries. Features Cloud BigQuery is a serverless data warehousing technology. It provides integration with the Apache big data ecosystem allowing Hadoop/Spark and Beam workloads to read or write data directly from BigQuery using Storage API. BigQuery supports a standard SQL dialect that is ANSI:2011 compliant, which reduces the need for code rewrites. Automatically replicates data and keeps [...]
Bookmarks Features Key Concepts Publisher-subscriber relationships Pricing Validate Your Knowledge Cloud Pub/Sub is a fully-managed real-time messaging service for event driven systems that allows you to send and receive messages between independent applications. Features Capable of global message routing to simplify multi-region systems. Synchronous, cross-zone message replication and per-message receipt tracking ensure at-least-once delivery at any scale. Pub/Sub delivers each message at least once, so the Pub/Sub service might redeliver messages. You can declare independent quota and billing for publishers and subscribers. Cloud Pub/Sub doesn’t have shards or partitions. You just need [...]
A fully managed NoSQL database service designed for large analytical and operational workloads and enables you to store terabytes or even petabytes of data. Features You can use Cloud BigTable to store and query time-series data. It is ideal for storing large amounts of single-keyed data. Scales seamlessly from thousands to millions of reads/writes per second. Resize your cluster nodes to adjust Cloud Bigtable throughput without restarting – all without downtime. Pricing When you use Cloud Bigtable, you are charged for the following: Type of Cloud Bigtable instance Total number of nodes in your instance's clusters Amount of storage that [...]
Fully managed NFS file servers on Google Cloud for Compute Engine and Google Kubernetes Engine instances Most commonly used for media rendering, data analytics, and managing shared content. Features Simple, fast, consistent, scalable, and easy to use network-attached storage. You can copy data from Cloud Storage to a filestore fileshare that is mounted on a Compute Engine instance. Data is encrypted at rest and in transit with system-defined keys or customer-supplied keys. Filestore instances are zonal resources that feature in-zone storage redundancy only. It is tightly integrated with Google Kubernetes Engine (GKE) so containers can reference the same shared data. [...]
A pay-as-you-go function as a service (FaaS) to run your code with zero server management. Features There is no need to provision, manage, or upgrade servers. Cloud Functions can be written using: Node.js Python 3 Go Java Automatically scales based on load without thinking about the infrastructure. Built-in security at role and per function level based on the least privilege principle. Allows you to trigger your code from Google Cloud, Firebase, and Google Assistant or call it directly from any web, mobile, or backend application via HTTP. To act on events, you shall define a trigger. Binding a function to [...]
A fully managed relational database service that scales horizontally with strong consistency. Features SLA availability up to 99.999% for multi-regional instances with 10x less downtime than four nines. Provides transparent, synchronous replication across region and multi-region configurations. Optimizes performance by automatically sharding the data based on request load and size of data so you can spend less time thinking about scaling your database and more time scaling your business. You can run instances on a regional scope or multi-regional where your database is able to survive regional failure. All tables must have a declared primary key (PK), which can be [...]
A fully managed relational database service. Cloud SQL is available for: MySQL PostgreSQL SQL Server Features Scale instantly with a single API call as your data grows. Automated and on-demand backups are available. You can restore your database instance to its state at an earlier point in time by enabling binary logging. Data replication between multiple zones with automatic failover. You can perform an analytics job by using BigQuery to directly query your CloudSQL instance. Networking Can be easily connected to App Engine, Compute Engine, Google Kubernetes Engine, and your workstation. Security Data is encrypted at rest and in transit [...]
Bookmarks Buckets Bucket Configurations Storage Classes gsutil tool Uploading objects to GCS Pricing Validate Your Knowledge An object storage service that stores data within buckets. Below is a sample Cloud Storage integration: Buckets The data you upload on Cloud Storage are called objects. An object is an immutable piece of data consisting of a file in any format. You store objects inside containers called buckets. All buckets belong to a project. Each project can have multiple buckets. You can also configure a Cloud Storage bucket to host a static website [...]
Bookmarks Features Cloud Run for Anthos What images you can deploy Pricing Is a managed compute platform that enables you to run stateless HTTP containers that are invokable via web requests or Pub/Sub events. Features Cloud Run is serverless which means it abstracts away all the infrastructure management and maintenance so you can focus more on building your application. In Cloud Run, your application must be run in containers that contain everything that your software needs to run including code, runtime, and system libraries. It automatically scales up or down from zero to [...]