o &hc@sJddlZddlZddlmZmZddlZddlmZddl m Z ddl m Z ddl mZddlmZddlmZddl m Z dd lmZmZmZmZddlmZddlZGd d d eZGd d d eZGdddeZGdddeZdedefddZddZddZddZddZddZ d d!Z!d"d#Z"d$d%Z#d&d'Z$d(d)Z%d*d+Z&d,d-Z'd.d/Z(e)d0krd1Z*d2gZ+d3gZ,d4Z-d5Z.d6Z/d7Z0d8Z1d9Z2ee-e.e/e0e1e2Z3e4d:e4e3e5e3ere6e3Z3e3d;Z7ej8e7dZ9e:d?d@Z;ee=dAZ?e=d;Z@Wdn 1swYd3ZAeeAZBe4dBe4eBe4dCe!eBe?ZCe4eCe4eDeCdDZEdDZFeCGD]%ZHeHIJdErSeHdFdKZEq?eHIJdGrceHdHdKZFq?e4dEdIeEdIe4dGdIeFdIeEeFdJZLdKdLeCMDZNe'e+eNe9ZOe&eFeNe9ZPe4dMe4eOe4dNe4ePdSdS)ON)ListOptional)ChatGroq) ChatOllama)PromptTemplate)LLMChain)r)PydanticOutputParser) BaseModelField validatorValidationErrorc@sJeZdZUeddZeed<eed<eed<eed<eddZeed<dS) SimpleOnlineCourseRecommendation)defaultplatform course_namereason_to_recommendrelevance_scorelinkN) __name__ __module__ __qualname__r rstr__annotations__intrrrA/var/www/eduai.edurigo.com/doc_train/edurigo_ai/Puru/tna_final.pyr s r c@s&eZdZUeed<eed<eed<dS)!SimpleOfflineCourseRecommendationrrrN)rrrrrrrrrrrs  rc@eZdZUeeed<dS)#CourseRecommendationsOutput_OfflinecoursesN)rrrrrrrrrrr rc@r)CourseRecommendationOutputrecommendationsN)rrrrr rrrrrr" r!r" llm_responsereturnc Cslzt|}tdi|}|WStjy#}ztd|d}~wty5}ztd|d}~ww)NzInvalid JSON format: zPydantic validation error: r)jsonloadsr"JSONDecodeError ValueErrorr )r$ parsed_jsonvalidated_dataeverrrparse_simple_llm_response#s r.csXt|}|jjj|_|}||jvr'td|dt|j|| }t|}|jjj|_g} | D]} | |jvrmtd| dt|jqY|j| d} fdd| D} || d} t dd d d }t j| |d d Wdn1swYt j| d d S)NzColumn 'z/' not found in skills file. Available columns: z0' not found in courses file. Available columns: )subsetcs(g|]\}}|||dqS))name descriptioncourseIdr).0_rowdescription_column id_column name_columnrr Hsz!excel_to_json..organization_skillsr DataIb1.jsonwutf-8encodingindent)pd read_excelcolumnsrlowerstripr)listdropnauniquetolistiterrowsopenr&dumpdumps) skills_file skills_column courses_filer9r7r8 df_skillsskills df_coursesrequired_columnscolr courses_listdata json_filerr6r excel_to_json-s6           r]cCst|trdd|dD}t|trdd|dD}t|tr-dd|dD}t|t|kr9tdddt||D}||d}td d d d }tj||d dWdn1sbwYtj |d dS)NcSg|] }|r|qSrrIr3skillrrrr:`z'string_data_to_json..,cSr^rr_)r3r0rrrr:crbcSr^rr_)r3descrrrr:frbz=The number of course names and descriptions must be the same.cSsg|] \}}||dqS))r0r1r)r3r0rdrrrr:mr;zDataFromString.jsonr>r?r@rBrC) isinstancersplitlenr)ziprOr&rPrQ)rV course_namescourse_descriptionsrZr[r\rrrstring_data_to_json]s   rlc Ctddd}tdgdd}|}||B}d|i}||}i}d}|jdD];} | } | dr:| }g||<q(| d rF| }g||<q(| d rc|rcd d | td dd D} | ||<d}q(|S)N gemma3:12brmodel temperature goals_strab You are an industry expert with over 10 years of experience in analyzing business goals and identifying the most critical skills required to achieve them. Given the following business goals: {goals_str} Analyze the requirements for each goal and provide a structured list of essential skills needed to address them effectively. For each goal , clearly indicate which one it pertains to. - Ensure the list of skills for each goal/problem is precise, diverse, and highly relevant. - Provide the skills in a comma-separated format on a line starting with "Skills:" immediately following the Goal statement. - Do not include explanations, extra text, or other formatting besides the Goal statement and the "Skills:" line. **Output Format Example:** Goal: Increase customer retention Skills: Customer Service, Communication, Problem-Solving Problem: High employee turnover Skills: Employee Engagement, Leadership, Compensation Strategy input_variablestemplate Goal:Problem:Skills:cSg|]}|qSrr_r`rrrr:zTNA_Goals..rcrrinvokecontentrIrg startswithrh) goalsllmskill_extraction_promptrrskill_extraction_chaininputresponseextracted_skills current_itemline skills_listrrr TNA_Goals{s:      rc Crm)Nrnrro problems_strav You are an industry expert with over 10 years of experience in analyzing business problems and identifying the most critical skills required to achieve them. Given the following business problems: {problems_str} Analyze the requirements for each problem and provide a structured list of essential skills needed to address them effectively. For each goal and problem, clearly indicate which one it pertains to. - Ensure the list of skills for each problem is precise, diverse, and highly relevant. - Provide the skills in a comma-separated format on a line starting with "Skills:" immediately following the Problem statement. - Do not include explanations, extra text, or other formatting besides the Problem statement and the "Skills:" line. **Output Format Example:** Goal: Increase customer retention Skills: Customer Service, Communication, Problem-Solving Problem: High employee turnover Skills: Employee Engagement, Leadership, Compensation Strategy rsrvrwrxrycSrzrr_r`rrrr:r{z TNA_Problems..rcr|) problemsrrrrrrrrrrrrr TNA_Problemss:      rc CPt|}i}|D]\}}t|}||}||@}t|t|d||<q |SN)existing_skillsmissing_skillssetitemsrJ required_skills_dictr<organization_skills_setanalysis_resultsitemrequired_skillsrequired_skills_setrrrrrfind_skill_gaps_goals rc Crrrrrrrfind_skill_gaps_problems rrc Cd|r|stdtddgdd}tddgdd}tdd d }|}|}||B}||d }||} | S) N0Goal/problem and missing skills must be providedgoal_or_problemmissing_skills_strS As an expert learning and development specialist, your task is to recommend the most suitable online courses that directly address the following: Business Goal/Problem: {{goal_or_problem}} Specific Skills Gaps Identified: {{missing_skills_str}} Recommendation Guidelines: 1. Identify the most critical online courses that precisely match the skill gaps 2. Only recommend courses with at least 95% relevance to the goal and missing skills 3. Provide a comprehensive rationale for each course recommendation 4. Consider courses from major online learning platforms (Coursera, Udemy, edX, etc.) Evaluation Criteria: - Direct alignment with the specific skills needed - Depth of content coverage - Practical applicability to the business goal - Potential to close the identified skill gaps **Recommended Output Format:** [Platform] Course Name - Relevance % - Detailed Relevance Explanation Example: [Coursera] Advanced Data Analysis for Marketing Professionals - 98% - Comprehensive course covering advanced statistical analysis, data visualization, and marketing-specific data interpretation techniques directly addressing the identified skill gaps in data analysis capabilities rsgoala You are a professional learning and development advisor. Given the user's business goal , and their identified missing skills, output the recommendation report in **STRICT JSON FORMAT**. ### JSON Output Format: {{ Goal:{{ "goalTitle": "string", "missing_skills": ["list", "of", "skills"], "course_recommendations_online": [ {{ "platform": "Platform name", "course_name": "Course title", "level": "Beginner / Intermediate / Advanced", "why_recommended": "Reason why the course is useful", "relevance_score": integer (0-100), "link": "Course URL or 'Available on [Platform]'" }} ] }} }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 --- ### Inputs: Goal / Problem: {goal} Missing Skills: {missing_skills_str} rnrrorrr)rrr}) rrcourse_recommendation_promptcourse_recommendation_prompt2rgoal_strronline_course_extraction_chain input_datar#rrrrecommend_online_courses_goals, . rc Cr) N+Problem and missing skills must be providedrrrrsproblemap You are a professional learning and development advisor. Given the user's business problem , and their identified missing skills, output the recommendation report in **STRICT JSON FORMAT**. ### JSON Output Format: Goal: {{ "problemTtile": "string", "missing_skills": ["list", "of", "skills"], "course_recommendations_online": [ {{ "platform": "Platform name", "course_name": "Course title", "level": "Beginner / Intermediate / Advanced", "why_recommended": "Reason why the course is useful", "relevance_score": integer (0-100), "link": "Course URL or 'Available on [Platform]'" }} ], "suggested_order": [ "Course 1 name", "Course 2 name", "Course 3 name" ] }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 --- ### Inputs: Goal / Problem: {problem} Missing Skills: {missing_skills_str} rnrrorrr) rrrrr problem_strrrrr#rrr!recommend_online_courses_problemss, 0 rc Csn|r|stdtgddd}tddd}|}|}tdt|t|||B}|||d}||} | S) Nz(Goal and missing skills must be providedrrcourse_data_jsonaQ You are a professional learning and development advisor. You are given: - A business goal - A list of missing skills - A database of available courses (with name and description) ### Business Goal: {goal} ### Missing Skills: {missing_skills_str} ### Available Courses: {course_data_json} Your task is to: 1. Evaluate each course for how well it helps achieve the goal and address the missing skills. 2. Select the most relevant courses (maximum 5). 3. For each course, return ONLY the following fields: - "course_name": string - "reason_to_recommend": string - "relevance_score": integer (0-100) Don't give any extra text . Just return JSON Output. Here is the JSON class to validate the output that you give. Make sure the check always passes. class SimpleOfflineCourseRecommendation(BaseModel): ### JSON Output Format: {{ Goal:{{ "goaltitle": "string", "missing_skills": ["list", "of", "skills"], "course_recommendations_offline": [ {{ "course_name": "Course title", "why_recommended": "Reason why the course is useful", "relevance_score": integer (0-100), "link": "Course URL or 'Available on [Platform]'" }} ], "suggested_order": [ "Course 1 name", "Course 2 name", "Course 3 name" ] }} }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 rsrnrrozgoal r)rrprintr}) rrcourses_available'course_recommendation_prompt_simplifiedrrrrrr#rrrrecommend_offline_courses_goals,F rc Cs^|r|stdtgddd}tddd}|}|}td||B}|||d}||} | S) Nrrrra You are a professional learning and development advisor. You are given: - A business problem - A list of missing skills - A database of available courses (with name and description) ### Business Goal: {problem} ### Missing Skills: {missing_skills_str} ### Available Courses: {course_data_json} Your task is to: 1. Evaluate each course for how well it helps achieve the goal and address the missing skills. 2. Select the most relevant courses (maximum 5). 3. For each course, return ONLY the following fields: - "course_name": string - "reason_to_recommend": string - "relevance_score": integer (0-100) Don't give any extra text . Just return JSON Output. Here is the pydantic class to validate the output that you give. Make sure the check always passes. class SimpleOfflineCourseRecommendation(BaseModel): class SimpleOfflineCourseRecommendation(BaseModel): ### JSON Output Format: Goal: {{ "problemTtile": "string", "missing_skills": ["list", "of", "skills"], "course_recommendations_offline": [ {{ "course_name": "Course title", "why_recommended": "Reason why the course is useful", "relevance_score": integer (0-100), "link": "Course URL or 'Available on [Platform]'" }} ], "suggested_order": [ "Course 1 name", "Course 2 name", "Course 3 name" ] }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 rsrnrrozgoal and missing skill setr) rrrrrrrrrr#rrr"recommend_offline_courses_problemsXs(F rcCs|r|stdtddgdd}tgddd}tdd d }|}|}||B}||d } ||B} |||d} | | } || } | j}| j}|d d }|d d }t|}tdt|tdt|}tdt|| dg}| dd}| dd}| dg}|p|}t |t rdd| dD}nt |t rtdd|Drdd|D}n|}d||||di}tdttj|dd |S)!NrrraE You are a professional learning and development advisor. Given the user's business problem , and their identified missing skills, output the recommendation report in **STRICT JSON FORMAT**. ### JSON Output Format: Problem: {{ "problemTtile": "string", "course_recommendations_online": [ {{ "platform": "Platform name", "course_name": "Course title", "level": "Beginner / Intermediate / Advanced", "why_recommended": "Reason why the course is useful", "relevance_score": integer (0-100), "link": "Course URL or 'Available on [Platform]'" }} ], "suggested_order": [ "Course 1 name", "Course 2 name", "Course 3 name" ] }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 --- ### Inputs: Goal / Problem: {problem} Missing Skills: {missing_skills_str} rsra You are a professional learning and development advisor. You are given: - A business problem - A list of missing skills - A database of available courses (with name and description) ### Business Goal: {problem} ### Missing Skills: {missing_skills_str} ### Available Courses: {course_data_json} Your task is to: 1. Evaluate each course for how well it helps achieve the goal and address the missing skills. 2. Select the most relevant courses (maximum 5). 3. For each course, return ONLY the following fields: - "course_name": string - "course_id" : string - "reason_to_recommend": string - "relevance_score": integer (0-100) Don't give any extra text . Just return JSON Output. Here is the pydantic class to validate the output that you give. Make sure the check always passes. class SimpleOfflineCourseRecommendation(BaseModel): class SimpleOfflineCourseRecommendation(BaseModel): ### JSON Output Format: Problem: {{ "problemTtile": "string", "missing_skills": ["list", "of", "skills"], "course_recommendations_offline": [ {{ "course_name": "Course title", "course_id" : Course ID from course_data_json, "reason_to_recommend": "Reason why the course is useful", "relevance_score": integer (0-100), }} ], "suggested_order": [ "Course 1 name", "Course 2 name", "Course 3 name" ] }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 rnrror```json```zc=============================================================================Offlieneeee Prob Startza=============================================================================Offlieneeee Prob EndzP--------------------------------------------------------------------------------course_recommendations_offline problemtitler problemTitlecourse_recommendations_onlinecSrzrr_r`rrrr:ur{z=recommend_online_offline_courses_problems..rccs|]}t|tVqdSNrfrJr3rrrr vz.cSg|] }|D]}|qqSrrr3sublistrarrrr:xreProblem)rrrrzB+=================================================================rCr)rrr}r~rIr&r'rgetrfrrgrJallrQ)rrrrrrrrrinput_data_onlineoffline_course_extraction_chaininput_data_offlinerecommendations_offlinerecommendations_onlinerecommendations_offline_data1recommendations_online_data1recommendations_offline_data2recommendations_online_data2recommendations_offline_datarecommendations_online_datarproblem_title_offlineproblem_title_onlinerfinal_problem_titlemissing_skills_list final_outputrrr)recommend_online_offline_courses_problemsst/E          rcCs|r|stdtddgdd}tgddd}tdd d }|}|}||B}||d } ||B} |||d} | | } || } | j}| j}|d d }|d d }t|}tdt|tdt|}| dg}| dd}| di}| dd}| dg}|p|}t |t rdd| dD}nt |t rtdd|Drdd|D}n|}d||||di}ttj|dd|S)Nrrra You are a professional learning and development advisor. Given the user's business goal , and their identified missing skills, output the recommendation report in **STRICT JSON FORMAT**. ### JSON Output Format: {{ Goal:{{ "goalTitle": "string", "course_recommendations_online": [ {{ "platform": "Platform name", "course_name": "Course title", "level": "Beginner / Intermediate / Advanced", "why_recommended": "Reason why the course is useful", "relevance_score": integer (0-100), "link": "Course URL or 'Available on [Platform]'" }} ] }} }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 --- ### Inputs: Goal / Problem: {goal} Missing Skills: {missing_skills_str} rsrak You are a professional learning and development advisor. You are given: - A business goal - A list of missing skills - A database of available courses (with name and description) ### Business Goal: {goal} ### Missing Skills: {missing_skills_str} ### Available Courses: {course_data_json} Your task is to: 1. Evaluate each course for how well it helps achieve the goal and address the missing skills. 2. Select the most relevant courses (maximum 5). 3. For each course, return ONLY the following fields: - "course_name": string - "course_id" : string - "reason_to_recommend": string - "relevance_score": integer (0-100) Don't give any extra text . Just return JSON Output. Here is the JSON class to validate the output that you give. Make sure the check always passes. class SimpleOfflineCourseRecommendation(BaseModel): ### JSON Output Format: {{ Goal:{{ "goaltitle": "string", "course_recommendations_offline": [ {{ "course_name": "Course title", "course_id" : Course ID from course_data_json, "why_recommended": "Reason why the course is useful", "relevance_score": integer (0-100), "link": "Course URL or 'Available on [Platform]'" }} ], "suggested_order": [ "Course 1 name", "Course 2 name", "Course 3 name" ] }} }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 rnrrorrrzd=============================================================================Offlieneeee Goal Start za=============================================================================Offlieneeee Goal Endr goaltitlerGoal goalTitlercSrzrr_r`rrrr:Fr{z9recommend_online_offline_courses_goal..rccsrrrrrrrrGrz8recommend_online_offline_courses_goal..cSrrrrrrrr:IrerrrrrrCr)rrrrrrrrrrrrrrrrrrrrrgoal_title_offlinegoal_data_onlinegoal_title_onlinerfinal_goal_titlerrrrr%recommend_online_offline_courses_goalsp-C           rcCs|r|stdtddgdd}tgddd}tdd d }|}|}||B}||d } ||B} |||d} | | } || } | j}| j}td t||d d}|d d}tdt|t|}t|}| dg}| dd}| di}| dd}| dg}|p|}t |t rdd| dD}nt |t rtdd|Drdd|D}n|}d||||di}ttj|dd|S)Nrrra You are a professional learning and development advisor. Given the user's business goals , and their identified missing problems, output the recommendation report in **STRICT JSON FORMAT**. ### JSON Output Format: {{ Problem:{{ "problemTitle": "string", "course_recommendations_online": [ {{ "platform": "Platform name", "course_name": "Course title", "level": "Beginner / Intermediate / Advanced", "why_recommended": "Reason why the course is useful", "relevance_score": integer (0-100), "link": "Course URL or 'Available on [Platform]'" }} ] }} }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 --- ### Inputs: Problem: {problem} Missing Skills: {missing_skills_str} rsra5 You are a professional learning and development advisor. You are given: - A business problem - A list of missing skills - A database of available courses (with name and description) ### Business Problem: {problem} ### Missing Skills: {missing_skills_str} ### Available Courses: {course_data_json} Your task is to: 1. Evaluate each course for how well it helps achieve the problem and address the missing skills. 2. Select the most relevant courses (maximum 5). 3. For each course, return ONLY the following fields: - "course_name": string - "reason_to_recommend": string - "relevance_score": integer (0-100) Don't give any extra text . Just return JSON Output. Here is the JSON class to validate the output that you give. Make sure the check always passes. class SimpleOfflineCourseRecommendation(BaseModel): ### JSON Output Format: {{ problem:{{ "problemtitle": "string", "course_recommendations_offline": [ {{ "course_name": "Course title", "why_recommended": "Reason why the course is useful", "relevance_score": integer (0-100), "link": "Course URL or 'Available on [Platform]'" }} ], "suggested_order": [ "Course 1 name", "Course 2 name", "Course 3 name" ] }} }} **Rules:** - Only return valid JSON, no markdown, no headings. - Use double quotes `"` around all keys and string values. - Ensure the JSON is syntactically correct (ready for `json.loads()`). - If a field is missing, use an empty string "" or empty array []. - Only give those courses which relevance_score more than 75 rnrrorrrrrrrrrrcSrzrr_r`rrrr: r{z>recommend_online_offline_courses_problems1..rccsrrrrrrrrrz=recommend_online_offline_courses_problems1..cSrrrrrrrr:rerrrrC)r)rrr}r~rrIr&r'rrfrrgrJrrQ)rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr*recommend_online_offline_courses_problems1\sr-B           r__main__8gsk_igZbGeSv0MAqutmjrX9HWGdyb3FYc1U6fPEfvHFdLNFytjmyPGUHzOIncrease sales in the new Southeast Asia market by 20% in the next fiscal year.z)Lack of effective internal communication.zUserSkillDataIB.xlsxcompetency_namezCourseDataIB.xlsxr0short_description lms_course_id json_outputr Fr) ensure_asciirDr=rr< SDASDASDASDADz'Required Skills for Goals and Problems:rzgoal:zproblem: ")rrcCsg|]}|dqS)rr)r3analysisrrrr:r{r:StartStart2)Qr&retypingrrpandasrElangchain_groqrlangchain_ollamarlangchain_core.promptsrlangchain.chainsrlangchain.output_parsersrlangchain_core.pydantic_v1r r r r r rrr"rr.r]rlrrrrrrrrrrrr groq_api_keybusiness_goalsbusiness_problemsrRrSrTcourses_columnr7r8rrrfr' course_datarQrrOfloadr[rr< courses_datarrequired_skills_problemskill_gap_analysis_problemtyperrkeyskeyrHrrIgoal_problem_dictvaluesall_missing_skills_problemabcxyzrrrrs         0==hjgeZG H