About this role

Data Engineer

JOB TITLE & JOB CODE Job Title (Job Code): Data Engineer

PURPOSE OF THE JOB

Contribute to the development of the next generation of data-driven tool (Dialog) for the needs of all DIS solutions
Ensure the Smart Rail Insight tool sustaining deployed in China for Qiji projects needs
Develop a tool for monitoring the operation, with purpose to be sell to final customers

ORGANISATION Organisation structure (job belongs to..) CHINA / D&IS

Reports directly to: China D&IS Technical Director

Other reporting to: D&IS Technology Center (Dialog development)

Direct reports: N/A

Network & Links Internal

External

Start-ups, IT companies, other industrial companies, suppliers, academics, research institute

Key accountabilities:

Define, develop, manage & sustain the data solution including storage, processing units and UI defined as the industrial solution for the program
Design technical solutions for production-grade and cyber-secure data solutions
Build multi-tenant data collector and storage
Build multi-tenant streaming and data processing in batch and near-real time flows
Design scalable data model, including SQL and NoSQL modeling
Assess and enhance the data quality of incoming data flows
Apply Data management and security components
Build customizable Analytical Dashboards
Evaluate the opportunities from new technologies
Apply strong testing and quality assurance practices
within a lean startup pathway and in collaboration of engineering & mobility experts, data scientists, software engineers, HMI designer and devops

Performance measurements:

Desirable:

Mandatory:

2 to 7 years in IT and/or digital companies or software or startups, at least 2 years work experience asper China immigration requirement
Extensive practice of data processing and software development, in Python or R or Java/Scala environment.
Experience in developing solution with Apache Spark, Apache Kafka and/or Nifi for production.
Experience of data modelling
Deep knowledge of SQL database configuration, eg. Postgres, MariaDB, MySQL
Knowledge with devops including docker and ansible
Experience with git and release management

Desirable:

Knowledge of Microsoft Azure or AWS or GCP.
Knowledge of network and security : SSL, certifcates, IPSEC, Active Directory, LDAP.
Knowledge about Machine Learning with scikit-learn, R, Tensorflow or another AI framework or toolkit
Good understanding of the Apache open source ecosystem
Competencies & Skills
Proven track record for designing stable solution, testing and debugging.
Demonstrated teamwork and collaboration in a professional setting
Proven capabilities with worldwide teams
Fluent English and French
You don’t need to be a train enthusiast to thrive with us. We guarantee that when you step onto one of our trains with your friends or family, you’ll be proud. If you’re up for the challenge, we’d love to hear from you!
Important to note
As a global business, we’re an equal-opportunity employer that celebrates diversity across the 63 countries we operate in. We’re committed to creating an inclusive workplace for everyone.
Job Type: VIE

Job Segment:

Data Engineer