Data Engineer (Infrastructure) | Genetsis
Data Engineer (Infrastructure)
We are looking for a competent, dedicated, and experienced Data Engineer, who will be responsible for developing and maintaining data processing software like databases. Responsible for optimizing the overall architecture of the big data cloud platform for e-commerce business, realizing the architecture design of multi-
business system data access, data mining analysis and data visualization, and supporting in implementation of solutions. Responsible for guiding engineers in technical verification and implementation, controlling the quality of the architecture, and solving technical problems in the project development process. Research related big data cutting-edge technologies, iteratively analyze and optimize the big data platform, study and judge the research and development direction of new tools in the big data field and organize the implementation according to the company’s project and business development characteristics.
Your duties include coordinating with managers and other professionals to understand what our clients want from their data, creating a unique data infrastructure, running tests on our designs to isolate errors, and updating systems to adapt to changes in the company’s needs.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Create and maintain optimal data pipeline architecture
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloud technologies such as Alicloud.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Keep our data reliable and secure.
Work with data and analytics experts to strive for greater functionality in our data systems.
Building data pipelines that are used to transport data from a data source to a data warehouse
Data exploitation: defining and distributing data to data analysts and managers in a useful and useable format.
Develop tools to gather more specific data to support business needs and build infrastructures with an IT, development engineer.
Data modeling-define, develop and deliver reports and tools to facilitate cross-functional departments
Architecture, consistent update.
Data mining: identify and gather data from relevant sources.
More than 5 years of system architecture experience, including at least 3 years of Python or Java, Scala, Python, Shell and big data development experience;
Familiar with cloud platform, including but not limited to cloud platforms such as AWS/Alicloud;
Proficient in CI/CD tools such as Kubernetes/Docker container service and Jenkins/Git;
Familiar with Spark framework, proficient in RDD, SQL, Streaming, MLLIB programming, proficient in Spark tuning;
Practical experience in big data processing and excellent problem-solving ability;
Retail and/or e-commerce knowledge is considered a plus
Familiarity with Power BI, Tableau, QlikView or other data visualizations preferred
Familiarity with Selenium, Scrapy or other data mining software preferred
Computer science, software engineering or related majors with bachelor’s degrees and above
English can be normal written and oral
G-Commerce Shanghai is a part of Genetsis Group which is one of the first E-commerce and digital marketing service providers of Western Europe. We are an online business partner that utilizes a proprietary AI-powered business intelligence model that drives our fully integrated e-commerce and digital marketing multiplatform
operations for global brands with a global team of experts, we are helping brands to maximize their performance across all social media channels and eCommerce platforms to boost sales, increase profits, and outperform their competitors. We are providing data model platform, e-commerce operations, digital marketing
services and strategy consulting. We believe in open communication, developing a diverse work force, and a philosophy of shared rewards. Welcome to Genetsis Shanghai office, it is a great place to build your career and enrich your life.
Genetsis E-Commerce offers a SaaS proprietary AI-powered business intelligence solution to manage fully integrated e-commerce and digital marketing data across platforms and marketing channels boosting sales, increasing profits, saving costs and outperforming brand’s competitors. Genetsis translates data into sales.
WHAT WE OFFER
Nice office environment
Fun office activities
Good working hours
International, multicultural working environment
You are bubbly, a true Data Engineer, and willing to show your uniqueness on the floor? We would like to meet