Manoj_P_Kurdekar_Assignment

Question 1: In this code, a Code Generation application is built using the Transformers library, specifically the T5 model. Here's a summary of the approach: 1. Install necessary packages and load the dataset using the Hugging Face datasets library. 2. Preprocess the dataset, including text cleaning and splitting it into training, validation, and test sets. 3. Tokenize the data using the T5 tokenizer. 4. Configure the Seq2Seq model for training and define training arguments. 5. Train the model using Seq2SeqTrainer. 6. Save the fine-tuned model and the tokenizer to Google Drive. 7. Generate code from provided prompts and calculate BLEU scores for evaluation. Question 2: In this code, a ChatBot application using GenAI Stack is built. The GenAI Stack is a powerful tool for building AI-driven applications with capabilities for natural language understanding and generation. Here's a summary of the approach: 1. Install GenAI Stack and other required packages. 2. Configure GenAI Stack components, including embedding, vector databases, ETL, language model, prompt engine, retriever, and memory. 3. Load data from PDF files using the ETL component. 4. Create a conversation loop where the user can enter queries. 5. The retriever component retrieves responses based on the user's queries. 6. The application allows interactive querying and responses, functioning as a ChatBot.