Summary
Lidl US is searching for the next Cloud and Data Engineer to join our IT Systems team! The Cloud and Data Engineer will design, build, and maintain scalable data infrastructure and cloud-based solutions to support advanced analytics and business intelligence. This role requires expertise in cloud platforms such as AWS, Azure, or Google Cloud, along with strong proficiency in data engineering tools and frameworks like Databricks, Spark, Pub/Sub Solutions, and SQL-based data warehousing. The Cloud and Data Engineer is responsible for developing robust data pipelines, ensuring data quality and security, and optimizing cloud resources for performance and cost-efficiency. They will collaborate with data scientists, software engineers, and DevOps teams to deliver end-to-end data solutions that drive strategic decision-making.
** This positions reports to our Headquarters in Arlington, VA on a hybrid, 3-days in-office, schedule. **
What You’ll Do
Essential Functions
•    Design and implement scalable data pipelines using Apache Spark and Databricks to process large volumes of structured and unstructured data.
•    Develop and maintain SQL-based data models and queries to support analytics and reporting needs across the organization.
•    Write efficient, reusable, and well-documented Python code for data transformation, automation, and integration tasks.
•    Collaborate with data scientists and analysts to ensure data availability and quality for machine learning and business intelligence use cases.
•    Build and manage cloud-based data infrastructure on platforms such as Microsoft Azure ensuring high availability and security.
•    Create and maintain interactive dashboards and reports using Power BI and MicroStrategy to deliver actionable insights to stakeholders and be the face of reporting for the business.
•    Optimize data workflows and cloud resource usage for performance and cost-efficiency.
•    Implement data governance, quality checks, and monitoring solutions to ensure data integrity and compliance.
•    Participate in code reviews, architecture discussions, and agile development processes to continuously improve data engineering practices.
•    Stay current with emerging technologies and best practices in cloud computing, data engineering, and business intelligence.
What You’ll Need
Required Knowledge, Skills, Abilities
•    Excellent verbal and written communication skills
•    Excellent interpersonal and customer service skills
•    Excellent organizational skills and attention to detail
•    Excellent time management skills with a proven ability to meet deadlines
•    Strong analytical and problem-solving skills
•    Ability to prioritize tasks and to delegate them when appropriate
•    Proficient in Microsoft Office Suite or related software
•    Technical experience with Azure Cloud, Data Explorer, & Data Factory.
•    Technical experience with Databricks & Apache Airflow.
•    Technical experience with Power BI.
•    Required languages are Python, Spark, SQL, & KQL.
•    Experience with iterative development and collaboration systems (Atlassian – JIRA & Confluence)
•    Scrum Framework for Project Planning & Release Management
Required Education, Certifications/ Licenses, Related Experience
•    Bachelor’s degree
•    3-5 years of experience in a related field
•    In lieu of degree, 5+ years of experience in related field will meet the education and related experience requirements listed above
Physical Job Requirements
•    Prolonged periods sitting at a desk and working on a computer
•    Must be able to lift up to 15 pounds at times
What You’ll Receive
At Lidl, we know that in order for our people to do their best, they must be at their best. That’s why as a company, we offer one of the most generous benefits packages in the industry.
All our Lidl employees are eligible to receive the following benefits:
•    Medical | Dental | Vision coverage
•    Paid Holiday & Paid Time Off (PTO)
•    401k Plan (+ 5% company match and 2 year vesting schedule)
•    And so much more, visit our benefits page for more details and the latest updates
In addition to the great benefits above, our Full-Time employees receive these additional benefits: Group Term Life & AD&D Insurance, Short & Long-Term Disability Insurance, Voluntary Critical Illness and/or Accident Insurance, Parental Leave – 100% pay for birth mothers and non-birth parents, Additional Paid Time-Off & Sick Time.
#LI-Hybrid
#LI-MS1
Employment Type: OTHER