Job offers

Python Data Engineer

140 - 160 PLN/h netto + vat (B2B)

100% Remote

Regular / Senior

Full-time

Wymagania

  • Senior

  • Regular

Minimum experience in IT: 5

Job description

We are looking for Data Engineer, who will join Data Team works on building and deploying novel analytical algorithms based on the data from IoT products. The person in this position will work on the full stack; from data pipelines and processing to creating user facing applications.


Your responsibilities:

● Build and run Azure based Data Platform.

● Handle multiple Terabytes of different domains data with focus on IoT data using Stream and Batch processing.

● Craft and maintain world-class, high traffic analytical applications and services with a team of experienced data engineers and scientists.

● Develop data models and process raw data at scale to make it available for analysis.

● Build scalable data pipelines using state-of-the-art technologies in the Microsoft Azure Cloud.

● Implement, run and deploy algorithms in cooperation with data scientists using the Hadoop ecosystem (e.g. Spark, Hive, HDFS) and the Microsoft Azure Stack).


What we expect:

  • At least 5 Years of experience in architecting and building Data Lake and Enterprise Analytics Solutions
  • Ability to optimize 'Big Data' data pipelines, design Data Lake architecture and data sets
  • Experience with Design and Architecture of relational SQL and NoSQL databases
  • Advanced hands-on SQL, Python, pySpark and HDFS knowledge and experience working with relational databases for data querying and retrieval
  • Experience with Design and Architecture of Azure big data frameworks: Azure Databricks, Azure Data Factory, Azure ML, SQL Data Warehouse, HDInsights, Stream Analytics, Azure Data Explorer - or their open source counterparts: Kafka, Spark, Blob Storages.
  • Knowledge of DevOps Processes (including CI/CD) and infrastructure as a code fundamentals
  • Knowledge of Data Quality issues and methods of dealing with them
  • Fluent in English


  • Required languages

    english B2

    Lack

  • Job Specification

    • Remote job

    Python Data Engineer

    140 - 160 PLN/h netto + vat (B2B)

    How it's working?

    • Anonymous

      There is no universal access to your resume and employment history. Employers view your anonymous profile, which contains all relevant information, to invite you to participate in recruitment.

    • Recruitment without a CV

      After creating an account in the IT-Leaders platform, you can apply for the offers you are interested in with just one click.

      Join now
    • Zero SPAM

      You only receive offers tailored to your profile and financial expectations.

    • You're in charge here

      You decide which employer will get access to your data. You also have constant access to all offers on the platform and you can apply to the selected company yourself at any time.