Facebook Twitter Youtube Whatsapp
Upload CV
FIND JOBS
UPLOAD CV
Job Descriptions

Data Engineer

Find the talent from anywhere in the world – Onboard them easily – Set up payroll and benefits in a few clicks

Talk To Our Expert

JOB OVERVIEW

Type of RoleFull Time
PositionData Engineer
Years of Exp. required4 to 7 years
Academic BackgroundBachelor’s degree in Computer Science or a related field.
CTCCompetitive and commensurate with experience
Work TypeWork from office
No. of Working Days in a Week5 Days

WHO ARE WE LOOKING FOR?

We are seeking a talented Data Engineer with solid programming experience in Python, Scala, or Java. The ideal candidate should have hands-on experience with data analysis, creating data pipelines, and orchestration on GCP tools like Dataflow, Data Fusion, Composer, and BigQuery. The candidate will also perform as a technical data lead, taking accountability for data hygiene and ensuring data integrity.

HOW DOES YOUR FIRST 10 DAYS LOOK LIKE?

  • Get familiar with ongoing projects and data engineering tools.
  • Collaborate with the team to understand current data pipeline processes.
  • Dive into code development and data analysis tasks.
  • Assume the role of a technical data lead, understanding tables, data use, replication, connection, and lineage

HOW DOES YOUR FIRST MONTH LOOK LIKE?

  • Actively participate in the development of data pipelines and ETL processes.
  • Collaborate with data architects, data scientists, and business analysts.
  • Work on optimizing and improving big data data pipelines.
  • Identify the needs of the business and develop solutions that fit these needs.

HOW DOES YOUR FIRST 3 MONTHS LOOK LIKE?

  • Take on more responsibilities in building and maintaining ETL processes.
  • Identify and solve complex problems in data architecture and data management.
  • Organize the integration of data and migration activities to enhance operating efficiency.
  • Participate in improving business activities by implementing innovative data solutions.

HOW DOES YOUR FIRST 6 MONTHS LOOK LIKE?

  • Develop robust data pipelines on the public Cloud using GCP, AWS, or Alibaba technologies.
  • Collect, process, and compute business metrics from data using Python/Spark.
  • Collaborate with the team on data discovery, modeling, mining, and archival.
  • Evaluate existing data systems and propose enhancements.

HOW DOES YOUR FIRST 12 MONTHS LOOK LIKE?

  • Serve as an integrator between data architects, data scientists, and other data consumers.
  • Contribute to the development of new analysis tools and metrics.
  • Work on projects measuring product engagement & consumability.
  • Continue performing as a technical data lead, ensuring data hygiene and integrity.

KRA'S YOU WILL OWN

PRIMARY

  1. Build and optimize big data data pipelines on public Cloud platforms.
  2. Collect, process, and compute business metrics from data.
  3. Develop data set processes for data discovery, modeling, mining, and archival.

SECONDARY

  1. Collaborate with data architects, data scientists, and business analysts.
  2. Serve as an integrator between various data-related roles.
  3. Contribute to the development of new analysis tools and metrics.

CHALLENGES YOU WILL OWN

  • Work closely with the data engineering team.
  • Collaborate with cross-functional teams, including data scientists and business analysts.

TOOLS yOU sHOULD bE wELL vERSED wITH

  •  Programming languages: Python, Scala, Java.
  • Big data technologies: Hadoop, Spark, Hive/Pig.
  • Cloud platforms: GCP, AWS, Alibaba.
  • Data processing tools: Dataflow, Data Fusion, Composer, BigQuery.
  • SQL and NoSQL databases: MongoDB, Cassandra, HBase, DynamoDB.
  • Version control: Git.
  • Agile software development and Scrum methodology.

CANDIDATE FIT

YOU ARE AN IDEAL CANDIDATE IF

  • Bachelor’s degree in Computer Science.
  • 2+ years of experience in big data analytics or related roles.
  • Strong analytical and critical thinking skills.
  • Proficiency in SQL.
  • Experience with ETL, data warehousing, and columnar databases.
  • Excellent written and verbal communication skills.
  • Positive, team-focused attitude.
  • Ability to manage multiple tasks and requests.

YOU ARE A WORTHY CANDIDATE IF

  • Familiarity with Agile software development and DevOps.
  • Spring Webflux, Web Client, ecommerce domain experience.
  • Knowledge of Spring Boot API development.
  • Experience as a technical data lead, ensuring data hygiene and integrity.

ROLE CLARITY

  • Actively participate in building and optimizing data pipelines.
  • Collaborate with data architects, data scientists, and business analysts.
  • Contribute to the development of new analysis tools and metrics.
  • Perform as a technical data lead, ensuring data hygiene and integrity.

COMPANY PERKS

  • Competitive salary.
  • Opportunities for professional development and training.
  • Exposure to cutting-edge technologies.
  • Collaboration with innovative teams.
  • Mentorship and career growth opportunities.
  • Work in a dynamic and creative environment.
  • A work culture focused on innovation and creating lasting value for our clients and employees.

TABLE OF CONTENTS

  • Job Overview
  • Who are we looking for ?
  • How does your first 10 days look like?
  • How does your 1st month look like?
  • How does your first 3 months look like?
  • How does your first 6 months look like?
  • How does your first 12 months look like?
  • KRA’s you will own
  • Channels you will own
  • Tools you should be well versed with
  • Candidate Fit
  • Role Clarity
  • Company Perks

Are you recruiting?

Email Us

Looking for Your Next Role?

Email Us
Footer Logo
North America
USA

[email protected]

Canada

[email protected]

Europe
London

[email protected]

Germany

[email protected]

Netherlands

[email protected]

Sweden

[email protected]

Switzerland

[email protected]

Czech Republic

[email protected]

Poland

[email protected]

Oceania
Australia

[email protected]

Asia
India

[email protected]

Find us on Glassdoor.
Trustpilot
Follow Us
Linkedin-in Facebook-f Instagram
SIA

© 2023 Avance Consulting. All Rights Reserved.

Footer Logo
North America
USA

[email protected]

Canada

[email protected]

Europe
London

[email protected]

Germany

[email protected]

Netherlands

[email protected]

Sweden

[email protected]

Switzerland

[email protected]

Czech Republic

[email protected]

Poland

[email protected]

Asia
Australia

[email protected]

India

[email protected]

Follow Us
Linkedin-in Facebook-f Instagram
SIA

© 2023 Avance Consulting. All Rights Reserved.

Avance Worldwide

Upload Your Resume

Optionally upload your resume for employers to view. Max. file size: 400 MB.
Talk to experts
Linkedin-in

Amit Kumar

President and Co-Founder

Amit has a diverse background in multiple industries including automobile, telecom, and banking, and is passionate about scaling up operations.

Amit has played an instrumental role in scaling operations of Avance Consulting and scaling it to over 10 countries with a team size of over 700 people and is rated as one of the top technology staffing companies in Europe.

Amit is passionate about coaching and building talent. He has been on the advisory board of a school. He has not only invested in multiple early stage start-ups but also coached entrepreneurs on scaling up their businesses.

Linkedin-in

Pravin Dudhe

CEO and Co-Founder

Pravin has been a serial entrepreneur all through his professional life, co-founded 2 successful companies and helped another start up build their business to give a successful exit. He has worked in the media and entertainment industry with focus on video games, animation and advertising across India and UK. He had a successful exit from his first few start-ups, Octoplus Entertainment (video-games and animation); and PhoneSpots (mobile advertising). 

Pravin is onto his 3rd venture, Avance Consulting, which is in the field of HR and Talent Solutions. Avance has operations in over 10 countries with a team size of 700 people and is rated as one of the top technology staffing companies in Europe. He is also an active investor in start-ups, especially, in early-stage companies. He has invested in over 10 different companies in the field of Ad-tech, HR-tech, and Reg-tech. He is passionate about start-ups and scaling up.