Робота системний інженер

We are looking for a Senior Data Engineer for a top global leader, manufacturing smart energy solutions.

As a Senior Data Engineer, you will work with the team to create state-of-the-art data and analytics driven solutions, working across platforms leveraging both On-prem, Platform, big data tools and technologies. You will be part of a data engineering team in charge both on AI and ML developing Interfaces/ data pipelines, typically involving large, complex data sets.

What will you be doing:
Thoughtful problem-solving: For you, problem-solving starts with a clear and accurate understanding of the context. You can decompose tricky problems and work towards a clean solution, by yourself or with teammates. You're comfortable asking for help when you get stuck.
Responsible for building data and analytical engineering solutions with standard end-to-end design & ETL patterns, implementing data pipelines, data modeling, data consumption, and query optimization.
Responsible to enable access of data in providers such as AWS storage layers and transformations in AWS Data warehouse and further transporting in respective databases, consumers, data marts etc.
Demonstrate proficiency knowledge of on web framework such as Flask or Django, as well as data integration frameworks such as dbt..

Experience with high-volume production environments including recovery and resilience infrastructures.
Identify downstream implications of data loads/migration (e.g., data quality, regulatory, etc.)

Requirements:
• A minimum of 4+ years of similar experience working on Database(s), ,Data warehouse, , ETL and AWS platform is required
• Experienced in Deployment process on-Premise and on- using , Dockers, Jenkins
• Experience with Technology Stacks such as ELK, Sentry, AirFlow
• Delivers results when working on shorter-term (weeks-months), outcome-focused service engagements
• Articulates the value proposition of existing technology capabilities and maps them to customer requirements to minimize incremental cost of development
• Experienced in working with On-Premise (Teradata) data warehouse – Dimensional and data modelling. Experienced in one of the ETL like Informatica
• Proficient with query and programming languages like , NodeJS
• Comfortable working with OS such as linux and shell scripting
• Experienced in working in AWS related compute, storage, and processing (S3, Glue, Lambda, Redshift, , Dynamo DB, Athena, Sagemaker)

Project Overview:
The Data Engineering team builds the apps and infrastructure to leverage data from our vehicles and operations. We are building the next generation data lake and pipelines as we scale our offerings. You will develop and implement the systems that power Luminar’s data-driven improvement and growth.

Responsibilities:
Designing, building, and maintaining the infrastructure that transforms data at scale into insights:
Ingestion of real-world vehicle data.
Automated labeling and data enrichment.
Generation of ground truth information.
Analysis of data quality.
Partnering with engineering and ML teams to define data consumption patterns and establish best practices.
Establishing robust data integrity and systems monitoring.
Requirements:
4+ years of relevant industry experience:
Building backend / data services at scale.
Hands-on Big Data software and infrastructure development skills.
Experience with NoSQL databases and/or Relational databases.
Accomplished in Python.
Demonstrated ability to work independently.
Timezone flexibility: Willingness to sync with colleagues working in the Palo Alto office for up to 1-2 hours a day.
Strong communication skills, being able to collaborate with the wider software organization.
Bachelor’s Degree (or higher) in Computer Science.
Experience with MongoDB.
Experience with pipeline / workflow frameworks: Argo Workflows or Airflow.
Hands-on experience with cloud computing: AWS / GCP / Azure / Alibaba Cloud.
Experience with automation of data infrastructure: Docker / Kubernetes / Terraform / Linux.
Experience with SRE practices - running services reliably in production environments:
Incident management and root cause analysis.
Performance Engineering.
Previous experience in the Automotive / Robotics industry.
Nice to have:
Proficiency in front-end development, preferably using React.
Experience with processing frameworks like Spark / Hadoop.
Experience with big data / data warehouse tools like Redshift, Presto/Athena, BigQuery and Snowflake.
Experience with streaming and message queueing technologies: Kafka / Kinesis / RabbitMQ.
Hands-on experience with data storage and transfer schemes like Avro, Parquet and Protobuf.
Experience with rosbags.
Higher Education:
Bachelor's Degree.

Avenga is happy to invite a Junior Support Engineer to join our team. You will maintain, upgrade and manage our software, hardware and networks. You should be able to diagnose and resolve problems quickly. You should also have the patience to communicate with a variety of interdisciplinary teams and users. Your goal will be to ensure that our technology infrastructure runs smoothly and efficiently.

Requirements:
-1+ year experience in a similar position;
-Confident in Windows 10, Ubuntu, MacOS;
-Good understanding of basic network protocols and services;
-Experience with Active Directory and Office/Microsoft 365;
-Knowledge of Google Workspace;
-Good at monitoring tools: Zabbix, PRTG, Splunk, etc.;
-Competent in Jira / Confluence;
-English – Intermediate or higher.

Responsibilities:
-Setup end-user corporate automated workplace;
-Install and configure standard corporate software on end-user workstations;
-Maintain end-user corporate hardware;
-Facilitate resolution of end-user corporate hardware and software issues and incidents;
-Adopt best practices of end-user data and environment maintenance in accordance with ISO27001 recommendations;
-Perform regular office IT hardware and software inventory checks;
-Fulfill the requirements of Information Security Management System Policies;
-Participate in the relevant projects according to corporate IT strategy.

Your benefits:
-Our employees get regular performance and salary reviews;
-We offer an attractive social and benefits package;
-Everyone at Avenga is subject to professional growth via our mentorship program;
-The company provides extended training and certification opportunities;
-We foster professional freedom by offering free-of-charge English courses from A1 to C2;
-We stay up to date with the industry by embarking on tech talks, webinars, conferences, and hackathons;
-Avenga cares for its employees well-being by providing well-rounded health insurance coverage and fitness compensation programs;
-Our employees’ families are no less important, as we offer maternity aid and financial support for a number of family reasons, including marriage and childbirth;
-The company fosters a sense of professional belonging and an environment of togetherness: we achieve things together and celebrate our milestones.

Qualifications & Experience:

• Bachelor’s degree or equivalent work experience
• 7+ Years of Experience working with databases (SQL, PL/SQL or any other equivalent) and good understanding of RDBMS concepts
• Knowledge on concepts and experience writing SQL and ETL code with the ability to analyze, diagnose, and tune for scale and performance.
• Knowledge on ETL tools like Talend and job schedulers like Tidal
• Strong Azure platform skills with DevOps, Data Factory, Databricks, Spark, Scala, Azure API Platforms, Azure Synapse
• Working experience Using Frameworks like; Platforms and Data Governance tools
• Good communication skills with ability to articulate the technical and functional aspects of a development/production problem to help drive solutions with App Dev teams and senior stakeholders

Additional Qualifications:

• Experience in the Financial Service Industry: Capital markets/Private Equity, securities processing
• Experience working in Agile or SAFe (scaled agile) using GIT Version Control
• Programming experience using SQL, PL/SQL, on windows/Linux server
• Experience with one of the following Scripting languages: Shell script, JavaScript or Python etc

Soft Skills:

• Strong critical thinking and problem-solving skills and a desire to take initiative
• Detail-oriented drive to investigate and dissect information with a strong focus on quality
• Excellent oral and written communication skills are mandatory
• Good interpersonal and communication skills; works well in a team environment

We offer:

• Friendly professional staff and warm atmosphere;
• The environment where you can implement your ideas;
• Plans for growth and performance review;
• Flexible schedule and opportunities to work remotely (8 hours workday);
• Paid 18 days of vacation and up to 10 sick leaves annually;
• Medical insurance after the trial period;
• English courses;
• Participation in educational activities and thematic conferences;
• Attending professional conferences, summits, workshops, and seminars (70% of the cost offset by the company);
• Team parties and corporate events.

Candidate Must Have:
✔️ Minimum 3+ years of commercial experience in Spark with Python;
✔️ Upper- intermediate English, written/spoken;
✔️ Strong overall knowledge of Data Engineering design and development principles;
✔️ Experience in building ETL / data warehouse transformation processes;
✔️ Direct, hands-on experience (preferably 3+ years) with building data pipelines leveraging technologies including: Apache Spark, Databricks, Airflow, SQL;
✔️ Comfortable working with various datastores and highly familiar with AWS functionality as a whole, including S3, RDS, Athena, Cloudwatch, Batch;
✔️ Humility. Strong learning mentality. Be open to learning new things;
✔️ History of communicating effectively with multiple stakeholders;
✔️ Demonstrated attention to detail and effective use of written communication.

Bonus Skills:
✔️Experience in healthcare data.

Why is this a special opportunity?
You will be joining a small existing Ukrainian team of Python developers whilst working closely with the US management. A great chance to improve English communication skills, learn more about the US business culture and be part of a fast-growing Scaleup that is writing history.
The team is very friendly, open to new ideas and inclusive.

Responsibilities:
✔️ Design, implement, maintain, and optimize data ingestion pipelines from multiple sources;
✔️ Recommend and implement best practices regarding how to add and maintain mappings as part of the project, in collaboration with the team;
✔️ Identify, recommend, and implement opportunities for data QA throughout the pipeline.

What We Offer:
✔️ Competitive salary based on experience and skills;
✔️ The opportunity to work with a modern technology stack and build innovative products long term (no bench time, no project switching!).
✔️ Plenty of opportunities for learning and continued career growth;
✔️ A great values-based company culture valuing general well-being;
✔️ Flexible working: total remote;
✔️ 20 days of paid annual leave; up to 10 days of paid sick leave (including 1 mental health day) per year;
✔️ Western business management and the opportunity to speak English daily;
✔️ Corporate events, merchandise, perks and general wellbeing.
✔️ Laptop (mac or Microsoft)

We are a company that is based on the values of integrity, kindness, honesty and respect.

Thank you for considering a career with us!

Candidate Must Have:
✔️ Minimum 3+ years of commercial experience in Spark with Python;
✔️ Upper- intermediate English, written/spoken;
✔️ Strong overall knowledge of Data Engineering design and development principles;
✔️ Experience in building ETL / data warehouse transformation processes;
✔️ Direct, hands-on experience (preferably 3+ years) with building data pipelines leveraging technologies including: Apache Spark, Databricks, Airflow, SQL;
✔️ Comfortable working with various datastores and highly familiar with AWS functionality as a whole, including S3, RDS, Athena, Cloudwatch, Batch;
✔️ Humility. Strong learning mentality. Be open to learning new things;
✔️ History of communicating effectively with multiple stakeholders;
✔️ Demonstrated attention to detail and effective use of written communication.

Bonus Skills:
✔️Experience in healthcare data;

Why is this a special opportunity?
You will be joining a small existing Ukrainian team of Python developers whilst working closely with the US management. A great chance to improve English communication skills, learn more about the US business culture and be part of a fast-growing Scaleup that is writing history.
The team is very friendly, open to new ideas and inclusive.

Responsibilities:
✔️ Design, implement, maintain, and optimize data ingestion pipelines from multiple sources;
✔️ Recommend and implement best practices regarding how to add and maintain mappings as part of the project, in collaboration with the team;
✔️ Identify, recommend, and implement opportunities for data QA throughout the pipeline.

What We Offer:
✔️ Competitive salary based on experience and skills;
✔️ The opportunity to work with a modern technology stack and build innovative products long term (no bench time, no project switching!).
✔️ Plenty of opportunities for learning and continued career growth;
✔️ A great values-based company culture valuing general well-being;
✔️ Flexible working: total remote;
✔️ 20 days of paid annual leave; up to 10 days of paid sick leave (including 1 mental health day) per year;
✔️ Western business management and the opportunity to speak English daily;
✔️ Corporate events, merchandise, perks and general wellbeing.
✔️ Laptop (mac or Microsoft)

We are a company that is based on the values of integrity, kindness, honesty and respect.

Thank you for considering a career with us!