Important Notice       Be aware of a scam where Redfish employees are being impersonated via WhatsApp and text messages

Read the Notice

CATCH OF THE DAY

High-tech industry news, companies, jobs, innovation and trends.

Tech It Jobs

We are hiring a Data Engineer to be at the forefront of our data infrastructure development. The key tasks of this role will include designing, constructing, installing, and maintaining the systems that allow for the seamless flow, availability, and reliability of data. Our ideal candidate will have expertise in ETL, reporting, data modeling, and data infrastructure, as well as the ability to work as part of a dynamic team with concurrent projects.

Typical Duties and Responsibilities

  • Develop and maintain scalable data pipelines for efficient data extraction, transformation, and loading (ETL) processes
  • Build new API integrations to support continuing increases in data volume and complexity 
  • Design and optimize data storage solutions, including data warehouses and data lakes
  • Ensure data quality and integrity through data validation, cleansing, and error handling
  • Collaborate with analytics and business teams to improve data models that feed business intelligence tools
  • Automate and improve data processes and workflows for scalability and efficiency
  • Implement processes and systems to monitor data quality
  • Implement data security measures and access controls to protect sensitive information
  • Monitor data infrastructure for performance and reliability 
  • Write unit/integration tests and document your work
  • Perform data analysis to troubleshoot data-related issues and assist in their resolution
  • Design data integrations and data quality framework
  • Design and evaluate open source and vendor tools for data lineage
  • Work with business units and engineering teams to develop strategy for long-term data platform architecture
  • Document data pipelines, processes, and best practices for knowledge sharing
  • Stay up to date on industry trends and emerging technologies in data engineering

Education

  • Bachelor’s degree in computer science, computer engineering, or a related field

Required Skills and Experience

  • 4+ years of experience developing in Python or Java
  • 4+ years of experience with SQL
  • Experience with schema design and dimensional data modeling
  • Experience with agile software development methodologies 
  • Experience designing, building, and maintaining data processing systems
  • Experience with ETL processes
  • Experience working with a Map Reduce or MPP system
  • Experience with big data technologies like Hadoop and Spark
  • Knowledge of best practices and IT operations in an always-available service
  • Knowledge of data warehousing and cloud platforms
  • Proficiency in data modeling and database management 
  • Excellent problem solving and troubleshooting skills
  • Strong oral and written communication skills

Preferred Qualifications

  • Experience with No-SQL