MQTT to Hadoop Sales Data Pipeline
PROJECT OVERVIEW We need a small, working proof of concept that collects retail sales transactions over MQTT, stores them locally in SQLite, loads them in…
Описание предложения
PROJECT OVERVIEW We need a small, working proof of concept that collects retail sales transactions over MQTT, stores them locally in SQLite, loads them into Hadoop (HDFS + Hive) and produces basic sales reports. Everything must run on one machine with Docker so we can demo it and build on it later. DATA FLOW 1. A sales simulator (Python) publishes transactions to an MQTT broker (Mosquitto) 2. A collector subscribes and saves every message in SQLite (it keeps working if Hadoop is down) 3. A loader moves new SQLite rows to HDFS on a schedule and on demand 4. Hive tables on HDFS and SQL queries produce the sales reports DELIVERABLES 1. : Mosquitto, single-node Hadoop 3.x (HDFS + YARN), Hive. One command starts it all. 2. Sales simulator - 5 stores, 200 products, configurable rate (defaul...
Навыки и категории
Похожие предложения
Proofreading Autobiography
I need a professional proofreader for my autobiography, focusing solely on grammar and spelling. The manuscript is in i…
AI Text Editor for Windows
I’m looking for a lightweight text-editing application for Windows 11 that feels as quick and simple as Notepad yet add…
App Video Content Creation
I have a mobile app and want its story told through compelling video. I need a creator who can plan, script, shoot (or…
High-Converting TikTok Ad Creation
I need a punchy, fun-filled TikTok video that turns scrollers into paying customers for my site, bsbooster.net. The spo…