Light weight end to end pipeline for ingesting documents into UDR

dc.contributor.advisor	Tatu, Aditya
dc.contributor.author	Patel, Prince Rakeshbhai
dc.date.accessioned	2020-09-22T08:06:03Z
dc.date.available	2023-02-16T08:06:03Z
dc.date.issued	2020
dc.identifier.citation	Patel, Prince Rakeshbhai (2020). Light weight end to end pipeline for ingesting documents into UDR. Dhirubhai Ambani Institute of Information and Communication Technology. v, 14 p. (Acc.No: T00836)
dc.identifier.uri	http://drsr.daiict.ac.in//handle/123456789/914
dc.description.abstract	The work describes here is to create an end to end data pipeline with open source tools and technologies available, we have used Nifi which is ETL (Extract, Transform and load) tool to ingest the data and transform it using the inbuilt processors which Nifi provide. The main aim is to create the data flow without writing code, cause it requires lots of management and man power and testing and integration time instead using the inbuilt processors given in the Nifi tool and do the configuration in that, and create the data pipeline so it can be quickly built and requires the least human intervention.
dc.publisher	Dhirubhai Ambani Institute of Information and Communication Technology
dc.subject	Data pipeline
dc.subject	Nifi
dc.subject	Azure DevOps
dc.subject	Kafka
dc.classification.ddc	005.3 PAT
dc.title	Light weight end to end pipeline for ingesting documents into UDR
dc.type	Dissertation
dc.degree	M. Tech
dc.student.id	201811004
dc.accession.number	T00836