ShaopengWang
Dedicated and results-driven Software Engineer with a proven track record of delivering innovative solutions in data infrastructure and engineering. Adept at orchestrating complex systems, automating processes, and optimizing data pipelines. Excels in cross-functional collaboration and thrives in dynamic, high-impact environments. Eager to leverage expertise in Cloud Computing, Distributed Systems, and Agile Development to drive success for a forward-thinking organization.
Experience
Software Engineer II
- Designed and developed data warehouse pipelines and tables using Spark 2.0, providing accurate and timely data for all departments in the region. Built new data warehouse tables to support analytics and provide a single source of truth on Operational performance regionally.
- Scheduled, monitored and troubleshot data warehouse jobs to ensure accuracy of data and timeliness of all reports.
- Optimized jobs and removed bottlenecks to improve the efficiency of the end-to-end data warehouse pipeline.
Software Engineer Internship
- Developed and maintained a data pipeline of large-scale data indexing. Calculated correlations between job title and relevant job skills based on real user profiles.
- Explored new hypotheses, built deep learning algorithms, and was responsible to maintain model quality over time.
Software Engineer Internship
- Applied data engineering and machine learning to correlate, enrich, and identify new ways of understanding the big data that were collected and streamed in Human Managed platform.
- Supported the creation of various use cases that will ultimately help end users to solve their business problems and make better decisions.
Engineering Internship
- Applied Random Forest algorithm to analyze parameters, predict optimal combination of instrument and improved experiment design efficiency.
- Developed Excel macro to improve efficiency in data analysis for experiment and strongly appreciated by colleagues.
- Implemented developed technical alternatives, assisted in design improvements for the conventional and Reduced Risk Products equipment / computerized systems.
Software Engineer Intern
- Developed a fertilizer recommendation tool, which provides non-dominated solutions based on farmers’ demand on nitrogen, potassium and phosphorous content, geographical location, soil content and season. Conducted a workshop about recommendation tool and received overwhelming feedback.
- Built a web framework, RESTful API, using AWS chalice and fine tuning with postman, reducing response time from beginning 30 seconds to 5 seconds.
- Built an image recognition model to detect rice disease with limited dataset and achieved 75% accuracy.
Education
Georgia Institute of Technology
Nanyang Technological University
GPA: 4.72
- Mathmatics: A+
- Discrete Mathmatics: A+
- Engineering Mathmatics: A+
- Cumputational Methods: A+
- Probability & Introduction to Statistics: A+
- Statistics: A+
- Digital Logic: A+
University of Wisconsin – Madison
Korea University
Skills
Python, Java, Go, SQL, R, JavaScript, HTML/CSS
GCP, Kubernetes, Spark, Airflow, Kafka, Maxwell, MySQL, NewSQL, Delta Lake, PostgreSQL, MangoDB, Presto, Hadoop, Grafana, Ansible, Atlassian, Kibana, Elasticsearch, React, Redis, Git, Agile Development (Scrum), Cloud Computing, Distributed Systems
Numpy, Pandas, Matplotlib, Scikit-Learn, Keras
Photoshop, Adobe Bridge, Autodesk Fusion 360
Awards & Certifications
The NTU Science and Engineering Undergraduate Scholarship is awarded to outstanding applicants from the Asian countries.
Dean's list is awarded to the top 5% student of the cohort, subject to attaining a minimum YGPA of 4.50.
Interests
Besides data analytics, I enjoy nighttime running, photography and chinese calligraphy. However, now, during the weekend, I usually either enjoy a meal with my girlfriend or play game ...