Senior Big Data Engineer Scala Python - Data&AI

Місто : , Odesa,
Компанія : Allegro
Зарплата :
Знайдено : 4 дні тому

Опис

The salary range for this position is (contract of employment): mid: 14 200 - 19 690 PLN in gross terms senior: 18 400 - 25 410 PLN   in gross terms A hybrid work model that incorporates solutions developed by the leader and the team About the team  As part of the Data & AI area, we implement projects based on the practical "data science" and "artificial intelligence" applications of an unprecedented scale in Poland. Data & AI is a group of over 150 experienced BigData engineers organized into over a dozen teams with various specializations. Some of them build dedicated tools for creating and launching BigData processes or implementing ML models for the entire organization. Others work closer to the client and are responsible for the implementation of the search engine, creating recommendations, building a buyer profile or developing an experimental platform. There are also research teams in the area whose aim is to find solutions to non-trivial problems requiring the use of machine learning. We are looking for BigData engineers who want to build a highly scalable and fault-tolerant data ingestion for millions of Allegro customers.  The platform collects 5 billion clickstream events every day (up to 150k / sec) from all Allegro sites and Allegro mobile applications. This is a hybrid solution using a mix on-premise and Google Cloud Platform (GCP) services like Spark, Kafka, Beam, BigQuery, Pubsub or Dataflow. We are looking for people who: Are programming in languages such as Scala, Python or Java Strong understanding of distributed systems, data storage, and processing framework - Spark. Have knowledge of GCP (especially Composer) or other public cloud environments like Azure or AWS Use good practices (clean code, code review, TDD, CI/CD) Navigate efficiently within Unix/Linux systems Possess a positive attitude and team-working skills Are eager for personal development and keeping their knowledge up to date Know English at B2 level Additionally, we offer: Possibility to learn and work with backend (Spring, Kotlin), frontend (angular) and AI technologies within the team. A hybrid work model that you will agree on with your leader and the team. We have well-located offices (with fully equipped kitchens and bicycle parking facilities) and excellent working tools (height-adjustable desks, interactive conference rooms) Annual bonus up to 10% of the annual salary gross (depending on your annual assessment and the company's results) A wide selection of fringe benefits in a cafeteria plan – you choose what you like (e.g. medical, sports or lunch packages, insurance, purchase vouchers) English classes that we pay for related to the specific nature of your job A 16" or 14" MacBook Pro with M1 processor and, 32GB RAM or a corresponding Dell with Windows (if you don’t like Macs) and other gadgets that you may need Working in a team you can always count on — we have on board top-class specialists and experts in their areas of expertise A high degree of autonomy in terms of organizing your team’s work; we encourage you to develop continuously and try out new things Wide range of internal and external trainings and time to participate, hackathons, team tourism, training budget and an internal educational platform, MindUp (including training courses on work organization, means of communications, motivation to work and various technologies and subject-matter issues) If you want to learn more,   check it out Why is it worth working with us At Allegro, you will be responsible for processing petabytes of data and billions of events daily You will become a participant in one of the largest projects of building a data platform in GCP Your development will align with the latest technological trends based on open source principles (data mesh, data streaming) You will have a real impact on the direction of product development and technology choices. We utilize the latest and best available technologies, as we select them according to our own needs You will have the opportunity to work within a team of experienced engineers and big data specialists who are eager to share their knowledge, including publicly through  allegro.tech Once a year, you can take advantage of the opportunity to work in a different team or more often if there’s an internal business need (known as  team tourism ) Send in your CV and see why it is #dobrzetubyć (#goodtobehere

Схожі вакансії

    Customer Data Platforms Data Engineer

    • , Warsaw ,
    • 7 годин тому

    ... a Data Engineer 5+ years of expertise in implementing and optimizing Customer Data Platforms 5+ years of exposure ... Azure Data Factory, Data Lake, Databricks, Azure Synapse, Azure SQL, Cosmos DB Expertise in PySpark, Python, SQL Strong analytical and problem ...

    jobs.jti.com

    Consumer Data Product Manager

    • , Warsaw ,
    • 7 годин тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    DC Service Delivery Manager

    • , Warsaw ,
    • 9 днів тому

    ... and escalate deviations to the data center service delivery lead Maximize ... employee referral program, your personal data will be processed until the ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    I&O DE Process Manager

    • , Warsaw ,
    • 7 годин тому

    ... decision making process adding data perspective into it Automation & AI   Assist I&O Digital User ... Experience Manager in preparation & analyses of different statistical data to find potential ...

    jobs.jti.com

    Marketing Automation Product Manager

    • , Warsaw ,
    • 7 годин тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    IT Business Expert Manager

    • , WARSAW ,
    • 7 годин тому

    ... automated forecast models based on AI, Machine Learning, Robotics, Data Mining, Improved user experience, or ... referral program, your personal data will be processed until the ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Business Expert Manager

    • , WARSAW ,
    • 5 днів тому

    ... automated forecast models based on AI, Machine Learning, Robotics, Data Mining, Improved user experience, or ... referral program, your personal data will be processed until the ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    IT Process Analyst Manager (SAP PPM & SAP PS)

    • , WARSAW ,
    • 7 годин тому

    ... . For that: you will assist senior team members in the analysis ... Business Intelligence groups assess master data and reporting requirements for key ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Process Analyst Manager (SAP PPM & SAP PS)

    • , WARSAW ,
    • 5 днів тому

    ... . For that: you will assist senior team members in the analysis ... Business Intelligence groups assess master data and reporting requirements for key ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Data Managment Associate

    • , Bucharest ,
    • 7 годин тому

    ... similar field, experience with modern data governance concepts, data modelling, and data management, and familiarity with cloud-based Big Data platforms and practices. Basic knowledge of SAP systems, proficiency in Python or R, and experience with ...

    jobs.jti.com

    Data Managment Associate

    • , Bucharest ,
    • 7 годин тому

    ... similar field, experience with modern data governance concepts, data modelling, and data management, and familiarity with cloud-based Big Data platforms and practices. Basic knowledge of SAP systems, proficiency in Python or R, and experience with ...

    jobs.jti.com

    Data Managment Associate

    • , Bucharest ,
    • 7 годин тому

    ... similar field, experience with modern data governance concepts, data modelling, and data management, and familiarity with cloud-based Big Data platforms and practices. Basic knowledge of SAP systems, proficiency in Python or R, and experience with ...

    jobs.jti.com

    IT Process Analyst Manager

    • , WARSAW ,
    • 7 годин тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    Process Analyst Manager

    • , WARSAW ,
    • 5 днів тому

    ... employee referral program, your personal data will be processed until the ... the processing of your personal data may be extended each time ... the processing of your personal data during the recruitment process, further ...

    jobs.jti.com

    DWH Architect Data Modeling

    • Kitopi
    • , Odesa,
    • день тому

    ... a plus.  Technologies we use: Data Warehouse Big Data: Snowflake, ADL, and Postgres  Reporting: Power BI  Data Pipelines: Kafka, Python, SQL, Airflow, Airbyte, and DBT  ...

    ua.talent.com

    DWH Architect Data Modeling

    • Kitopi
    • , Kyiv,
    • 5 днів тому

    ... a plus.  Technologies we use: Data Warehouse Big Data: Snowflake, ADL, and Postgres  Reporting: Power BI  Data Pipelines: Kafka, Python, SQL, Airflow, Airbyte, and DBT  ...

    ua.talent.com

    Data Governance Manager

    • , Bucharest ,
    • 7 годин тому

    ... pertaining to the use of data assets to achieve efficiency and effectiveness in the business processes represent data as a strategic business asset at the Senior Management table • Facilitate Data Governance solutions evaluation from technical ...

    jobs.jti.com

    Senior Data Scientist

    • , Manila ,
    • 4 дні тому

    ...  organizations Experience working with data science languages such as R or Python and mastering SQL. Knowledge of major cloud computing platforms (i.e. Microsoft Azure) Knowledge of major Big data storage (i.e. data lake), analytical engines (i ...

    jobs.jti.com

    Senior Product Analyst

    • Travelist Sp. z o.o.
    • , Kyiv,
    • 18 годин тому

    ... Data Warehouse Engineer -  https: careers.secretescapes.com blog my-first-hack-day-kirsten-grieve-data-warehouse-engineer   The story behind Secret Escapes ... Senior Leadership in Product and Data to shape and prioritise the ... . Python, R, dbt)   We are an ...

    ua.talent.com

    Senior Product Analyst

    • Travelist Sp. z o.o.
    • , Odesa,
    • 18 годин тому

    ... Data Warehouse Engineer -  https: careers.secretescapes.com blog my-first-hack-day-kirsten-grieve-data-warehouse-engineer   The story behind Secret Escapes ... Senior Leadership in Product and Data to shape and prioritise the ... . Python, R, dbt)   We are an ...

    ua.talent.com
Top