4 days ago Be among the first 25 applicants
Direct message the job poster from Decskill
Decskill, founded in 2014 as an IT Consulting Company, places paramount importance on its greatest asset: its people. Our main mission is to deliver value through knowledge and talent, and we achieve this by fostering a culture of excellence and investing in the development and well-being of our people. With over 600 dedicated professionals and offices in Lisbon, Porto, Madrid, and Luxembourg, Decskill operates across three core areas:
* DECSKILL TALENT: We believe that our people are key to our success. Through Decskill Talent, we empower our team to embrace the digital transformation challenges of our clients. We collaborate with clients to drive innovation, ensuring project success and business growth.
* DECSKILL BOOST: Equipping our team with the latest tools and methodologies, we optimize Time-to-Market and deliver innovative solutions exceeding client expectations.
* DECSKILL CONNECT: Our team collaborates closely with clients to implement and manage IT infrastructures that generate long-term value.
At Decskill, we believe that by nurturing and empowering our people to confront the challenges of digital transformation, we create value not only for our clients but also for our entire ecosystem, fostering a digital community dedicated to growth and progress.
We are looking for an Data Engineer!
Responsabilities:
* Maintaining the infrastructure that supports the current data architecture.
* Creating data pipelines in Airflow for data extracting, processing, and loading.
* Data pipelines maintenance, monitoring, and stability.
* Providing data access to data analysts and end-users.
* DevOps infrastructure.
* Deploying Airflow dags to production environment using DevOps tools.
* Code and query optimization.
* Code review.
* Improving the current data architecture and DevOps processes.
* Delivering data in useful and appealing ways to users.
* Performing and documenting analysis, review, and study on specified regulatory topics.
* Understanding business change and requirement needs, assess the impact and the cost.
Requirements:
* Advanced Python.
* Experience in creating APIs in Python - At least Flask.
* Experience in documenting and testing in Python.
* Advanced SQL skills and relational database management (Oracle is Mandatory, SQL server is desirable, PostgreSQL is desirable).
* Experience with Data Warehouses.
* Hadoop ecosystem - HDFS + Yarn.
* Advanced PySpark.
* Apache Airflow - Experience in both pipeline development and deploying Airflow in distributed environment.
* Containerization - Docker.
* Experience in creating and maintaining distributed environments using Hadoop and Spark
* Data Lakes - Experience in organizing and maintaining data lakes (Mandatory) - S3. PLUS
* Experience with Parquet file format is mandatory, Avro. PLUS
* Experience in automating applications deployment using DevOps tools - Jenkins is Mandatory, Ansible is a plus
* Agile methodologies (At least SCRUM).
* Strong analytical abilities, able to have the right synthesis and all possible details at same time
* Team spirit.
* Client Focus.
* Adaptability skills.
* Good level of english.
If you’re interested in this job, please send your CV to cesaltina.abreu@decskill.com with reference “CA/RiskRegisterOfficer".
Seniority level
* Seniority level
Not Applicable
Employment type
* Employment type
Contract
Job function
* Job function
Information Technology
* Industries
IT Services and IT Consulting
Referrals increase your chances of interviewing at Decskill by 2x
Sign in to set job alerts for “Data Engineer” roles.
Junior Backend Developer – Lisbon, Oporto & Vila Real
Software Engineer I - Front end focused (Viator)
Software Engineer, All Levels - London & Lisbon
FullStack Software Engineer (React/Node)
Fullstack Developer - NodeJS and ReactJS
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr