What should you use for data ingestion and stream processing?

HOTSPOT

You are developing an application that will perform clickstream analysis. The application will ingest and analyze millions of messages in the real time.

You need to ensure that communication between the application and devices is bidirectional.

What should you use for data ingestion and stream processing? To answer, select the appropriate options in the answer area. NOTE: Each correct selection is worth one point.

View Answer

Answer:

Explanation:

Box 1: Azure IoT Hub

Azure IoT Hub is the cloud gateway that connects IoT devices to gather data and drive business insights and automation. In addition, IoT Hub includes features that enrich the relationship between your devices and your backend systems. Bi-directional communication capabilities mean that while you receive data from devices you can also send commands and policies back to devices.

Note on why not Azure Event Hubs: An Azure IoT Hub contains an Event Hub and hence essentially is an Event Hub plus additional features. An important additional feature is that an Event Hub can only receive messages, whereas an IoT Hub additionally can also send messages to individual devices. Further, an Event Hub has access security on hub level, whereas an IoT Hub is aware of the individual devices and can grand and revoke access on device level.

Box 2: Azure Hdinsight with Azure Machine Learning service

References: https://docs.microsoft.com/en-us/azure/iot-hub/iot-hub-compare-event-hubs

https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-machine-learning-overview