Associate Data Engineer (SQL)

Yêu cầu kinh nghiệm

- Demonstrate knowledge and real-world experience on Big data technologies. A successful history of manipulating, processing and extracting value from large disconnected datasets.

- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

- Strong analytic skills related to working with unstructured datasets.

- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.

- We are looking for a candidate with > 2+ years of experience in a Data Engineer role. They should also have experience using the following software/tools:

• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL databases such as Oracle, SQL Server, MySQL or Postgres.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

- Some experience on visualization tools such as PowerBI/Tableau or other BI tools will be beneficial. 

QUALIFICATIONS

- Degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field

- 2+ years of relevant experience.