Web Mining Platform - WPF GUI
- Implemented GUI with .NET WPF.
- GUI could drag diagrams and be connected with arrows to build a job flow.
- Implemented a File Explorer to browse HDFS with HDFS APIs.
Web Mining Platform - Full-Stack Web GUI
- Implemented GUI with Front-end (HTML、jQuery、Bootstrap) and Back-end (Java).
- Rendered statistics charts with Spotfire.
Web Mining Platform - Service
- Implemented Yarn job dispatcher and job services with Java.
- Auto scheduled and ran the job flow which parallelly executed by Apache Hadoop/Spark.
- Built a switch/branch job flow dispatch algorithm by using graph theory.
- Reduced the time of pre-processing wafer data to 30% by folder partition.