Milestone IT, in partnership with a leading national retail chain, is seeking a talented AWS Data & Web Automation Engineer to drive innovation and enhance the functionality of their high-traffic e-commerce website.
This is a crucial role focused on automating processes, improving website performance, and ensuring robust security and scalability.
Key Responsibilities: Design, build, and optimize web automation and data pipelines on AWS to enhance website functionality and performance.Develop and manage RESTful APIs using API Gateway and secure them with WAF and CloudFront.Implement event-driven architectures utilizing Pub/Sub and EventBridge to support real-time website updates and data processing.Utilize AWS DMS to manage database migrations and ensure seamless data flow.Design, optimize, and scale relational databases using Amazon RDS (MySQL, PostgreSQL, or Aurora) to support website operations.Develop and optimize ETL processes using AWS Glue and PySpark to manage website data and analytics.Manage large-scale data storage and retrieval using AWS S3, including lifecycle policies and encryption.Build serverless data processing functions using AWS Lambda (Python/Node.js) to automate website processes.Develop and manage workflows using AWS Step Functions to orchestrate complex website operations.Implement messaging queues using AWS SQS for reliable communication between website components.Manage virtual private clouds (VPCs) and network configurations to ensure secure website deployment.Write complex SQL queries for data transformation and reporting related to website performance and user behavior.Utilize Apache Spark and Athena for large-scale data querying and analysis to support website optimization.Implement Infrastructure as Code (IaC) using CloudFormation, AWS SAM, CDK to automate website infrastructure deployment.Design and implement CI/CD pipelines using Jenkins or GitLab to ensure rapid and reliable website updates.Configure monitoring and logging solutions using CloudWatch, NewRelic, and Splunk to ensure website health and performance.Implement security best practices, including IAM and role-based access control, to protect website data and user information.Required Skills and Experience: Extensive experience with AWS services, including:API Gateway, WAF, CloudFrontS3, Lambda, Step Functions, DynamoDB, SQS, VPCGlue, DMS, RDS, AuroraProven experience in building infrastructure for public and internal RESTful APIs.Strong understanding of event-driven architectures (Pub/Sub, EventBridge).Solid experience with Infrastructure as Code (IaC) using CloudFormation, AWS SAM, CDK.Experience with CI/CD tools: Jenkins, GitLab.Deep expertise in AWS Data Services, including:AWS DMS: Configuring migration tasks, understanding replication methods, and troubleshooting performance issues.Amazon RDS: Designing, optimizing, and scaling relational databases.AWS Glue: Developing ETL scripts and managing Glue Crawlers and Data Catalog.AWS S3: Best practices for large-scale data storage and retrieval.AWS Lambda: Developing event-driven data processing functions.Strong understanding of data engineering and ETL pipeline design.Experience with big data processing using Apache Spark and Athena.Experience with monitoring and logging tools (CloudWatch, NewRelic, Splunk).Strong understanding of security and compliance best practices.Preferred Qualifications: AWS certifications (e.g., AWS Certified Developer - Associate, AWS Certified DevOps Engineer - Professional).Experience in the retail e-commerce industry. #J-18808-Ljbffr