Logo of Huzzle

Home

Matches

Explore

Manage

Data Engineer

image

Lyft

16d ago

  • Job
    Full-time
    Junior Level
  • Data
    Engineering
  • Toronto
  • Quick Apply

AI generated summary

  • You need 2+ years in data engineering, strong Spark and Hadoop skills, proficiency in SQL and Python, and experience with workflow tools. Insurance data pipeline experience is preferred.
  • You will design and implement data pipelines, optimize ETL processes, collaborate with partners and stakeholders, and lead technical decisions to enhance insurance operations.

Requirements

  • Experience:
  • 2+ years of relevant professional experience
  • Strong experience with Spark
  • Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
  • Strong skills in a scripting language (Python, Ruby, Bash)
  • Good understanding of SQL Engine and able to conduct advanced performance tuning
  • Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
  • Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
  • Comfortable working directly with data and business partners to bridge Lyft’s business goals with data engineering
  • Preferred to have experience of building and maintaining insurance related data pipeline for large organizations

Responsibilities

  • Design and implement insurance and claim-related data pipeline to help optimize insurance operation strategies
  • Tune ETL and MapReduce job to improve data processing performance
  • Partner with external insurance partners and Lyft business stakeholders to ensure seamless execution within established timelines
  • Owner of the core company data pipeline, responsible for converting the business and engineering need to efficient & reliable data pipelines
  • Main contributor to the team roadmap and lead the team to make the right technical decisions

FAQs

What is the main responsibility of the Data Engineer at Lyft?

The Data Engineer will design and implement insurance and claim-related data pipelines to optimize insurance operation strategies and will be responsible for converting business and engineering needs into efficient and reliable data pipelines.

What are the required years of experience for this role?

A minimum of 2 years of relevant professional experience is required for this position.

Which technologies should I be proficient in for this role?

Proficiency in Spark, Hadoop (or similar), S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Presto, Pig, HBase, and Parquet is required, as well as strong skills in at least one scripting language (Python, Ruby, Bash).

Will I have to work in the office?

Yes, this role requires working in the Toronto office on a hybrid schedule, which includes being in the office 3 days per week.

Is experience in insurance data pipeline relevant for this position?

Yes, it is preferred to have experience building and maintaining insurance-related data pipelines for large organizations.

What benefits does Lyft offer to its employees?

Lyft offers extended health and dental coverage, mental health benefits, family building benefits, paid time off, a Health Care Savings Account, and paid parental leave, among others.

Are there opportunities for professional growth within Lyft?

Yes, as a Data Engineer, you will be a key contributor to the team roadmap and will lead technical decisions, providing opportunities for professional growth and development.

How does Lyft approach diversity and inclusion in the workplace?

Lyft is committed to fostering an open, inclusive, and diverse environment, ensuring every team member is valued for their unique contributions, and actively promotes equal employment opportunities.

Can I work remotely for part of the year?

Yes, hybrid roles have the flexibility to work from anywhere for up to 4 weeks per year.

What is the focus of Lyft's data strategy?

Lyft's data strategy focuses on using data as the foundation for decision-making to enhance transportation experiences and inform financial strategies through insights derived from data processing and analytics.

Lyft

Ride by ride, we’re reimagining the world’s best transportation.

Transportation
Industry
5001-10,000
Employees
2012
Founded Year

Mission & Purpose

Lyft was founded in 2012 by Logan Green and John Zimmer to improve people’s lives with the world’s best transportation, and is available to approximately 95 percent of the United States population as well as select cities in Canada. Lyft is committed to effecting positive change for our cities by offsetting carbon emissions from all rides, and by promoting transportation equity through shared rides, bikeshare systems, electric scooters, and public transit partnerships.