Published in Geek Culture·PinnedMember-onlyFully Managed RStudio on Amazon SageMakerHarness the power of R on AWS with Rstudio as a fully managed platform on AWS Sagemaker. A great deal of data scientists use R as programming language for their projects. To work efficiently, data scientists prefer working with RStudio. …6 min read6 min read
Published in Geek Culture·PinnedMember-onlyRunning Serverless Spark Applications with AWS Lambda.Leverage Amazon SageMaker Processing to run serverless Spark applications from AWS Lambda. A widely known big data processing framework such as Apache Spark needs no introduction. …AWS8 min readAWS8 min read
Published in Geek Culture·Nov 3, 2022Member-onlyRunning Cloud Functions LocallyThe best way to test your functions before deploying. Learn how to run your cloud functions locally before deploying to Google Cloud. Cloud Functions supports writing source code in several programming languages. The runtime and the type of function will determine how to structure our code and implement our functions. …Python3 min readPython3 min read
Published in Geek Culture·Oct 31, 2022Member-onlyCreating Serverless Spark Jobs with Google CloudWrite scalable Spark applications and data pipelines without any manual infrastructure provisioning or tuning. When it comes to data processing, with Google Cloud one size does not fit all. Today, engineers have a lot of flexibility as they can choose between serverless, Kubernetes clusters, and compute clusters for their Spark…Spark6 min readSpark6 min read
Published in Geek Culture·May 3, 2022Member-onlyWorking with Amazon S3 Object LambdaLearn how to use S3 Object Lambda to process and transform your data as it is being retrieved from Amazon S3. Introduction Many organizations use Amazon S3 to store data at scale. By storing the data on Amazon S3, data can be easily shared across different applications and services. In some…AWS11 min readAWS11 min read
Published in Geek Culture·Feb 12, 2022Member-onlyTrain and Deploy Custom Machine Learning Models using Vertex AILearn to train and deploy custom machine learning models using Vertex AI Vertex AI is a platform that unifies Google Cloud’s Machine Learning (ML) offerings into a single environment for building and managing the entire lifecycle of ML projects. …Google Cloud Platform6 min readGoogle Cloud Platform6 min read
Published in Geek Culture·Dec 3, 2021Member-onlyCreating AWS Lambda Functions with AWS CDKLearn how to quickly create and deploy AWS Lambda functions using AWS CDK and Python. AWS Lambda is a serverless computing platform provided by AWS that lets you run code without provisioning or managing servers. It is an event-driven, highly scalable, fully managed service. It offers significant benefits for developers: …AWS7 min readAWS7 min read
Published in Geek Culture·Dec 2, 2021Member-onlyBuilding an Apache Kafka cluster using AWS CDK.Stream data with a fully managed, highly available Apache Kafka service. — What is Apache Kafka? AWS describe Apache Kafka as a distributed data store optimized for ingesting and processing streaming data in real-time. It is a great tool for working with data streams and it provides three main functions to its users: Publishing/subscribing to streams of records. Storing streams as they were generated.AWS5 min readAWS5 min read
Published in Geek Culture·Nov 24, 2021Member-onlyDeploying Amazon Managed Apache Airflow with AWS CDKLearn to easily deploy Apache Airflow as a managed service on AWS using Python and the AWS CDK. Amazon Managed Workflows for Apache Airflow (MWAA) is a managed orchestration service for Apache Airflow. An easier way to set up and operate end-to-end data pipelines in the cloud at scale. There…Airflow5 min readAirflow5 min read
Nov 12, 2021Member-onlyDesplegando imágenes de contenedor AWS LambdaAprender a desplegar funciones AWS Lambda usando imágenes de contenedor y AWS CDK. AWS Lambda es uno de los servicios más conocidos de AWS. Según la web de AWS, AWS Lambda es un servicio informático que permite ejecutar código sin aprovisionar ni administrar servidores. …7 min read7 min read
