Senior Data Engineer Python - Remote

Since our founding in 2012, Lotlinx has consistently pioneered advancements in the automotive landscape.
We specialize in empowering automobile dealers and manufacturers by providing cutting-edge data and technology, delivering a distinct market advantage for every single vehicle transaction.
Today, we stand as the foremost automotive AI and machine learning powered technology, excelling in digital marketing, risk management, and strategic inventory management.

Lotlinx provides employees with a dynamic work environment that is challenging, team-oriented, and full of passionate people.
We offer great incentives to our employees, such as competitive compensation and benefits, flex time off, and career development opportunities.

Job Summary

The Senior Data Engineer will be responsible for the development and deployment of cloud-first ETL processes, Data management, Data Warehousing and more in the Automotive Digital Advertising industry.
LotLinx is looking for a candidate who thrives in a fast-paced, collaborative environment and can utilize data to improve, optimize and lead further development of our data aggregation processes.

This hybrid position is located in either our Winnipeg or Hamilton office locations.

Key Responsibilities

• Design, build, and maintain robust, scalable, and efficient data pipelines to process large-scale datasets from multiple sources.
  
• Develop and manage ETL/ELT workflows for data ingestion, transformation, and loading into data lakes and warehouses.
  
• Architect and implement cloud-based solutions (AWS, GCP) to ensure data security, scalability, and high availability.
  
• Work with stakeholders including Analytics, Product, and Design teams to assist with data related technical issues and support their data infrastructure needs.
  
• Partner with DevOps and Security teams to ensure compliance with data governance, privacy, and security standards.
  
• Engineer solutions for large data storage, management.
  
• Proactively identify and resolve performance bottlenecks, scaling challenges, and technical issues.
  
• Explore available technologies and design solutions to continuously improve our data quality, workflow reliability, scalability while reporting performance and capabilities.
  
• Act as an internal expert in each of the data sources so that you can own overall data quality.
  

Qualifications:

• 5+ years of experience in data engineering or a similar role, with a focus on designing and managing scalable data systems.
  
• Proven expertise with cloud platforms, specifically AWS and/or GCP.
  
• Proficiency in SQL, including advanced query optimization and data modeling techniques.
  
• Strong programming skills in Python, Scala, or Java, with a focus on developing data processing applications.
  
• Experience with Data Engineering tools such as Airflow, Dataflow, DBT.
  
• Experience with big data frameworks like Apache Spark, Hadoop, or Beam.
  
• Hands-on experience with real-time data streaming platforms such as Apache Kafka, Pub/Sub, or Kinesis.
  
• Knowledge of CI/CD pipelines, version control systems (e.g., Git), and containerization technologies (e.g., Docker, Kubernetes).
  
• Experience managing data warehouses and lakes using modern platforms such as Snowflake, BigQuery, or Redshift.
  
• Familiarity with data governance frameworks, security best practices, and compliance standards.
  
• Demonstrated ability to solve complex technical challenges, think creatively and innovate within cloud and data ecosystems.
  
• Work with stakeholders including Analytics, Product, and Design teams to assist with data related technical issues and support their data infrastructure needs.
  
• Partner with DevOps and Security teams to ensure compliance with data governance, privacy, and security standards.
  
• Engineer solutions for large data storage, management.
  
• Proactively identify and resolve performance bottlenecks, scaling challenges, and technical issues.
  
• Explore available technologies and design solutions to continuously improve our data quality, workflow reliability, scalability while reporting performance and capabilities.
  
• Act as an internal expert in each of the data sources so that you can own overall data quality.
  

Qualifications:

• 5+ years of experience in data engineering or a similar role, with a focus on designing and managing scalable data systems.
  
• Proven expertise with cloud platforms, specifically AWS and/or GCP.
  
• Proficiency in SQL, including advanced query optimization and data modeling techniques.
  
• Strong programming skills in Python, Scala, or Java, with a focus on developing data processing applications.
  
• Experience with Data Engineering tools such as Airflow, Dataflow, DBT.
  
• Experience with big data frameworks like Apache Spark, Hadoop, or Beam.
  
• Hands-on experience with real-time data streaming platforms such as Apache Kafka, Pub/Sub, or Kinesis.
  
• Knowledge of CI/CD pipelines, version control systems (e.g., Git), and containerization technologies (e.g., Docker, Kubernetes).
  
• Experience managing data warehouses and lakes using modern platforms such as Snowflake, BigQuery, or Redshift.
  
• Familiarity with data governance frameworks, security best practices, and compliance standards.
  
• Demonstrated ability to solve complex technical challenges, think creatively and innovate within cloud and data ecosystems.
  

The salary range for this position is $108,000 - $162,000.

Lotlinx is committed to creating a diverse environment and is proud to be an equal opportunity employer.
All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

Lotlinx is not currently able to offer sponsorship for employment visa status.

Lotlinx is headquartered in Peterborough, NH and has locations in Holmdel NJ, Manitoba, Ontario and British Columbia, Canada in addition to a large team spanning from the US to Canada.

Our success relies heavily on our customers but also our dedicated talent that continuously moves our platform forward.
We value our employees, their abilities and seek to foster an open, cooperative, dynamic environment where the team and company alike can thrive.