数据工程全栈班15期 Final Demo | Team DataAlchemists 项目展示 | 澳洲 IT

The business goal of this project is to build a recommendation system to assist product marketing by analyzing and processing more than three million orders and sales data of online retail customers. This project comprehensively covers the most practical content of a business data project: from demand analysis to data processing, data architecture construction, machine modeling and visualization. Through this project, students can learn how to build databases and data processes on the AWS cloud, use big data tools to process and transform data, analyze data and build models, and finally productize the project and create value. You will learn how to build a data lake with s3 on AWS, use AWSathena and lambdafunction to process data, then use stepfunction and spark to build the entire process, and finally use sagemaker and apigateway to build a data product app. This project contains multiple data files, and many cloud solutions are used in the process of processing and modeling. The project is highly comprehensive, with good breadth and depth, and tests how students deal with problems encountered in real business environments. The experience gained by students in the project can be directly applied to work. 此项目的商业目标是通过分析和处理网络零售商客户的三百多万条订单和销售数据，搭建一个推荐系统来辅助产品的市场销售。这个项目非常全面的涵盖了一个商业数据项目最实用的内容：从需求分析做起，一直到数据处理，数据架构搭建，机器建模和可视化。通过这个项目学生可以学习到如何在AWS云上搭建数据库以及数据流程，用大数据工具处理和转换数据，分析数据和搭建模型，最后把项目产品化并且创造价值。你将会了解到如何在AWS上用s3搭建数据湖，用AWSathena和lambdafunction去处理数据，然后用stepfunction和spark去搭建整个流程，最后用sagemaker和apigateway去建立一个数据产品的app。此项目包含了多个数据文件，处理和建模的过程中用到了很多云上的解决方案，项目综合性很高，有很好的广度和深度，考验了学生如何处理在真实的商业环境中所遇到的问题。学生们在项目中所汲取的经验可以直接被应用到工作中。