Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- //perform avg/groupby operation on DF return result DF
- DataFrame outputDF = dataOperationService.performOperation(dataFrame);
- List<Row> rows = outputDF.collectAsList();
- KafkaProducer<String, String> producer = initKafkaProducer();
- try {
- for (Row row : rows) {
- String deptName = row.getString(0);
- double salary = row.getDouble(1);
- producer.send(new ProducerRecord<>(topicName, deptName+ "," + salary)).get();
- }
- } catch (Exception ignored) {
- System.out.println("Something went wrong.");
- } finally {
- producer.close();
- }
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement