Important Notice       Be aware of a scam where Redfish employees are being impersonated via WhatsApp and text messages

Read the Notice

CATCH OF THE DAY

High-tech industry news, companies, jobs, innovation and trends.

Big Data Jobs

Our data analytics team is in need of a new Back End Developer with expertise in big data. This role will oversee the creation and maintenance of our database infrastructure. Typical tasks will include collecting and maintaining data, ensuring the integrity of our data, and creating and training data models. A successful candidate will have experience implementing multi-level projects in accordance with business needs and developing infrastructure that can effectively interact with a large stream of data.

Typical Duties and Responsibilities

  • Identify the most suitable technology solutions for our big data needs
  • Design the architecture of our big data platform
  • Create and manage products that process a large amount of data
  • Design and implement data stores that support the storage and scalable processing of our high-frequency data
  • Maintain the data pipeline
  • Write scripts and SQL queries
  • Perform and oversee web scraping
  • Customize and monitor integration tools, warehouses, databases, and analytical systems
  • Configure data access tools used by all data scientists
  • Prepare reports
  • Maintain documentation of potential performance improvements
  • Support data security 
  • Test at different stages of product development

Education

  • Bachelor’s degree in computer science, data science, or a related field

Required Skills and Experience

  • 3+ years of experience in data engineering
  • 2+ years of experience with real-time data stream platforms
  • Experience with data cleaning, visualization, and reporting
  • Experience working in an agile environment
  • Experience with platforms such as MapReduce, Cassandra, Hive, Presto, and HBase
  • Proficiency in at least one programming language
  • Thorough knowledge of SQL
  • Knowledge of data visualization and automation tools
  • Knowledge of the Hadoop ecosystem
  • Knowledge of different architectures and data infrastructures
  • Knowledge of the basics of machine learning
  • Excellent analytical and problem solving skills
  • Excellent communication skills