BLOG

Home » BLOG » Page 12

A Compact Guide to Building Your First DAG with Amazon Managed Workflows for Apache Airflow

2023-11-30T05:46:03+00:00

In the vast realm of data processing, orchestrating workflows becomes crucial to ensure tasks run efficiently and reliably. Apache Airflow has revolutionized this aspect, providing a flexible platform to define, schedule, and monitor workflows. Combining this with Amazon's managed service, we can supercharge our workflow setup without the overhead of manual maintenance. In this guide, we dive deep into constructing your first Directed Acyclic Graph (DAG) using Apache Airflow, elucidating each component and step involved. Directed Acyclic Graph (DAG) At its core, a DAG is a collection of vertices and edges, where each edge has a direction, and there are [...]

A Compact Guide to Building Your First DAG with Amazon Managed Workflows for Apache Airflow2023-11-30T05:46:03+00:00

Serverless Model Deployment in AWS: Streamlining with Lambda, Docker, and S3

2023-11-30T06:08:01+00:00

Welcome back to our series on model deployment in AWS! In the fast-paced world of machine learning and data science, the ability to deploy models efficiently and reliably is crucial. This is where AWS services, with their vast array of tools and capabilities, come into play. In this second installment, we will delve into the potent combination of AWS Lambda and Docker, coupled with the convenience of storing models in S3. This trio offers a scalable, cost-effective, and streamlined solution for deploying machine learning models in a production environment. If you recall, in the first part of our series, we [...]

Serverless Model Deployment in AWS: Streamlining with Lambda, Docker, and S32023-11-30T06:08:01+00:00

Deploying a Trained CTGAN Model on an EC2 Instance: A Step-by-Step Guide

2023-11-30T06:39:56+00:00

Welcome to the first entry in our series on deploying machine learning models in AWS. As cloud computing and machine learning continue to evolve and intersect, understanding the dynamics of deployment becomes invaluable. Whether you're an enthusiast, a budding data scientist, or a seasoned professional, the insights offered by this series are tailored to empower you to make the most of AWS's vast ecosystem. One recurrent pitfall in the journey of many machine learning beginners is the confinement of their models within the boundaries of a Jupyter notebook. Picture this: after hours or even days of data wrangling, feature engineering, [...]

Deploying a Trained CTGAN Model on an EC2 Instance: A Step-by-Step Guide2023-11-30T06:39:56+00:00

Migrating from Universal Analytics to Google Analytics 4

2023-11-08T22:47:45+00:00

You can observe how users interact with your websites and online products using Google Analytics, which tracks users across all your websites and apps. The data collected contains the web pages your customers access and their activities, which include taps, scrolls, purchases, and other consumer actions. Google Analytics 4 (GA4) has replaced the old Universal Analytics as of June 2023. This transition means that post-June 2023, you'll be using GA4 by default. Hence, it's important to upgrade to the latest version to continue tracking analytics from your applications. Fundamental changes to be aware of before migrating: GA4 uses a brand-new [...]

Migrating from Universal Analytics to Google Analytics 42023-11-08T22:47:45+00:00

Setting Up Redirects on Amazon S3 for a Custom Domain Registered with Amazon Route 53

2023-11-06T08:50:20+00:00

This article will guide you on creating redirects on Amazon S3 for a website with a custom domain registered with Amazon Route 53. The following services will be used: Amazon Route 53 for domain registration and routing internet traffic, Amazon S3 for bucket creation, uploading a redirection script, configuring permissions for public access, and configuring the buckets for website hosting. In this example, we will redirect a custom domain registered with Amazon Route 53 instead of using this lengthy URL. - https://aws.amazon.com/developer/community/community-builders/community-builders-directory/?cb-cards.sort-by=item.additionalFields.cbName&cb-cards.sort-order=asc&awsf.builder-category=*all&awsf.location=*all&awsf.year=*all&cb-cards.q=Nestor%2BMayagma%2BJr.&cb-cards.q_operator=AND STEPS Step 1: Go to Amazon S3 → Buckets → Create bucket Follow the configurations below: Follow this [...]

Setting Up Redirects on Amazon S3 for a Custom Domain Registered with Amazon Route 532023-11-06T08:50:20+00:00

Mastering AWS CDK Part 1: Using Built-In Constructs for Serverless APIs

2023-10-27T05:39:10+00:00

In the realm of Infrastructure as Code (IaC) within AWS, CloudFormation stands out as the foundational service. Many other IaC solutions, whether it's the Serverless Framework, AWS SAM, or even Terraform, ultimately get translated into CloudFormation. Additionally, the AWS Cloud Development Kit (CDK) has emerged as a distinct player in this space. What sets AWS CDK apart is its embrace of familiar programming languages. Instead of relying on YAML or proprietary syntax, with AWS CDK, developers can define infrastructure using languages like Python, Javascript, Typescript, Java, C#, and Go. This familiarity accelerates the adoption curve, enabling developers to direct their [...]

Mastering AWS CDK Part 1: Using Built-In Constructs for Serverless APIs2023-10-27T05:39:10+00:00

Cloud Native: The Future of Application Development

2024-01-30T01:05:43+00:00

If you could do a quick search on the definition of cloud native, chances are you would be confused by the amount of different sources with varying definitions. The term "cloud native" has become a buzzword within the tech industry, symbolizing a paradigm shift in how software applications are designed, developed, and deployed. But what exactly does cloud native mean? The varying definitions of cloud native may be primarily because of its evolving definition over time. While some sources define cloud native as an approach where developers initially design applications to thrive in a cloud environment, others emphasize the utilization [...]

Cloud Native: The Future of Application Development2024-01-30T01:05:43+00:00

Creating a Slack Notification for Redis Errors with Lambda Function and CloudWatch Logs Integration

2023-10-22T14:15:34+00:00

As more companies turn to cloud solutions, monitoring and notification systems for errors are becoming increasingly crucial. Redis, an open-source, fast, in-memory key-value data store, is now a widely used solution for databases, cache, message brokers, and queues. However, like any software, Redis may experience errors that require immediate attention. This article will guide you through setting up an automated Slack Notification using Lambda Function and CloudWatch Logs Integration to receive real-time alerts when Redis errors occur. Let's begin by configuring the CloudWatch agent to send Redis logs to CloudWatch Logs by running sudo vi /opt/aws/amazon-cloudwatch-agent/bin/config.json in SSH. Suppose you [...]

Creating a Slack Notification for Redis Errors with Lambda Function and CloudWatch Logs Integration2023-10-22T14:15:34+00:00

Introduction to Kubernetes

2023-10-16T05:25:03+00:00

Containerization has set the gold standard for deploying applications on both on-premises and cloud environments. As microservices architecture becomes more popular, people increasingly embrace containerization because it naturally fits this architectural approach. Containerization brings many advantages: It guarantees portability. This technology's inherent isolation lets developers deploy their application code on various environments and operating systems without worrying about compatibility. It boosts scalability. Developers can deploy containers quickly and repeatedly. Unlike virtual machines, containers don't require booting up an entire operating system, letting developers scale up or down quickly by adding or removing containers on single or multiple machines. It enhances [...]

Introduction to Kubernetes2023-10-16T05:25:03+00:00

AWS Certified Data Engineer Associate Exam – DEA-C01 Study Path

2024-07-16T09:00:52+00:00

Bookmarks AWS Certified Data Engineer Associate DEA-C01 Exam Domains AWS Certified Data Engineer Associate DEA-C01 Exam Topic Is taking the AWS Certified Data Engineer Associate DEA-C01 Beta Exam worth it? Learn about the AWS Certified Data Engineer Associate Exam Topics The AWS Certified Data Engineer - Associate (DEA-C01) certification exam evaluates a candidate's ability to implement data pipelines and address performance and cost issues while adhering to AWS best practices. The certification validates the candidate's proficiency in designing and implementing scalable and secure data solutions using various AWS services. The target candidate for [...]

AWS Certified Data Engineer Associate Exam – DEA-C01 Study Path2024-07-16T09:00:52+00:00

AWS, Azure, and GCP Certifications are consistently among the top-paying IT certifications in the world, considering that most companies have now shifted to the cloud. Upskill and earn over $150,000 per year with an AWS, Azure, or GCP certification!

Follow us on LinkedIn, Facebook, or join our Slack study group. More importantly, answer as many practice exams as you can to help increase your chances of passing your certification exams on your first try!