SummaryWe are seeking an experienced Data Engineer with a proven track record in building and maintaining data pipelines, developing applications, and implementing data management solutions. The ideal candidate combines technical expertise with hands-on development skills to drive our data engineering initiatives.Requirements4-5 years of professional experience in data engineeringStrong proficiency in Python for data processing, ETL/ELT development, and application buildingAdvanced SQL skills for complex data querying, optimization, and database designExperience with Apache Airflow for workflow orchestration and schedulingKnowledge of low-code development platforms (such as Tooljet) for rapid application creationAbility to build and deploy data applications using StreamlitExtensive data management experience including data governance, quality control, and metadata managementKey ResponsibilitiesDesign, build, and maintain efficient data pipelines to process structured and unstructured dataCreate and optimize SQL queries for data extraction and transformationDevelop and manage Airflow DAGs for reliable workflow orchestrationUtilize low-code tools to accelerate application development where appropriateBuild interactive dashboards and tools using Streamlit for data visualization and explorationImplement data management best practices throughout the data lifecycleCollaborate with data scientists, analysts, and other stakeholders to understand requirementsTechnical SkillsProgramming Languages: Python, JavascriptDatabase Technologies: SQL (PostgreSQL, MySQL, or similar)Orchestration: Apache AirflowLow-Code Development: Tooljet or similar platformsETL/ELT Tools: Apache Nifi, KNIME, Apache SparkLakehouse Solution: SnowflakeApplication Development: StreamlitVersion Control: GitData Processing: Experience with batch and streaming data processingPreferred QualificationsExperience with cloud platforms (AWS, Azure, or GCP)Knowledge of containerization technologies (Docker, Kubernetes)Familiarity with big data technologies (Spark, Hadoop)Understanding of data modeling and dimensional modeling conceptsSuccess in this RoleThe successful candidate will bridge the gap between raw data and valuable insights by building reliable data infrastructure and intuitive applications, ensuring that data is accessible, trustworthy, and actionable across the organization.
#J-18808-Ljbffr