o RhY @s*ddlZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z ddl m Z ddlZddlmZddl mZddlmZmZdd lmZdd lmZmZmZmZdd lmZdd lmZdd l m!Z!m"Z"ddl#m$Z$m%Z%m&Z&ddl'm(Z(ddl)m*Z*ddl+Z+dZ,dZ-ddZ.d0ddZ/ddlZddlZddZ0ddZ1ddZ2e3dkrdZ,dZ4d Z5d!Z6gd"gd#gd$gd%gd&gd'd(d)ggd*d+Z7gd"gd#gd$gd%gd&gd'gd*d,Z8e9e8Z:e;d-e;e:e;d.e1e5e6e:d/\Ze<dSdS)1N)OllamaEmbeddings)FAISS)ChatPromptTemplate)AsyncWebCrawler)ChatGroq)PromptTemplate)StrOutputParserPydanticOutputParser)RunnablePassthrough) PyPDFLoader TextLoaderDocx2txtLoaderUnstructuredPowerPointLoader) PdfReader)SemanticChunker) BaseModelField)ListOptionalDict)urlparse) ChatOllama8gsk_igZbGeSv0MAqutmjrX9HWGdyb3FYc1U6fPEfvHFdLNFytjmyPGUHznomic-embed-textc Cstdtdd}g}|D] }|dd}|dd}|r&||d|q ||q d|}td d gd d }|j|d ddd|d dddd} z$|| } | j } t d| t | } | duriWdS| j dd} W| | fSt y}zt d|WYd}~dSd}~ww)Nrllama-3.3-70b-versatile temperature groq_api_key model_namename description:  skills_db job_profilesa You are an expert in skill-to-job-profile mapping. Your task is to validate,refine and map skills to job profiles to ensure accuracy, completeness, and clarity. ### Input: ### Available Skills: {skills_db} ### Job Profiles (with descriptions where available): {job_profiles} ### Output Format: {{ "Job Profile 1": ["Skill 1", "Skill 2", "Skill 3"], "Job Profile 2": ["Skill 4", "Skill 5"], "Job Profile 3": ["Skill 6", "Skill 7", "Skill 8"] }} ### Enhanced Mapping Guidelines: 1. **Leverage Job Descriptions:** - Use the provided job descriptions to better understand the role requirements. - Map skills that align with the specific responsibilities and expertise mentioned in descriptions. 2. **Ensure Relevance:** - Verify that each skill is appropriately mapped to the correct job profile(s) based on both the role name and description. - Remove any incorrectly assigned skills. 3. **Check for Completeness:** - Identify and add missing skills relevant to each job profile based on the description context. - For profiles without descriptions, use industry-standard expectations for that role. 4. **Refine Overlapping Skills:** - If a skill belongs to multiple job profiles, ensure it is correctly included in each where relevant. - Consider the description context to determine skill relevance. 5. **Improve Consistency & Clarity:** - Standardize skill naming to avoid duplicates with different names. - Use precise and industry-recognized terminology. 6. **Handle Profiles with/without Descriptions:** - For profiles with descriptions: prioritize skills that match the described responsibilities. - For profiles without descriptions: use standard industry expectations for that role title. 7. **Include Soft Skills Where Relevant:** - Evaluate the job description for behavioral, interpersonal, or communication requirements. - Map relevant soft skills such as Communication, Problem Solving, Teamwork, Leadership, or Adaptability when implied or directly stated - Do not exclude soft skills if they play a crucial role in client-facing or collaborative roles. 7. **Response Format:** - **ONLY return the JSON object without any explanations, comments, or additional text.** - **DO NOT wrap the JSON in code blocks (```json ... ```).** - Use the exact job profile names as provided in the input. input_variablestemplate{{{}}})r#r$Raw API response:Nr token_usage total_tokens*An error occurred during chat invocation: )r GROQ_API_KEYgetappendjoinrformatreplaceinvokecontentprintextract_json_from_responseresponse_metadata Exception)r#job_profiles_datachatformatted_job_profilesprofilerr job_profiles_text system_promptformatted_promptoutputoutskill_to_JobProfile_mappingtoken_consumederIP/var/www/eduai.edurigo.com/doc_train/edurigo_ai/skill_map/prod/jobProfile_map.pymap_skills_to_jobProfiles>    ;  rKmixtral-8x7b-32768c Cstddd}tddgdd}|j||d}z||}|jd }|j} W| |fStyA} ztd | WYd} ~ d Sd} ~ ww) Nhttp://127.0.0.1:11434 llama3:8bbase_urlmodelr# JobProfileay You are an expert in skill-to-Job Profile mapping. Your task is to analyze a given set of skills and map them to the most appropriate JobProfile. ### Input Skills: {skills_db} ### Designations: {JobProfile} ### Output Format: {{ "JobProfile 1": ["Skill 1", "Skill 2", "Skill 3"], "JobProfile 2": ["Skill 4", "Skill 5"], "JobProfile 3": ["Skill 6", "Skill 7", "Skill 8"] }} ### Notes: - Ensure that each skill is mapped only to the most relevant JobProfile(s). - If a skill fits multiple JobProfile, include it in both. - Use clear and concise mappings. - Respond only with the JSON object in the specified format, without any additional text. - If you found no skills for some JobProfile check does JobProfile at last one more time ### Instructions: - **Respond only with the JSON object in the specified format.** - **Do not include any additional text, explanations, or code fences (e.g., ```json).** - **Ensure that the JSON is properly formatted and valid.** r%)r#rR output_tokensr0r-)rrr5r7usage_metadatar8r<r9) r#rRrrr>rBrCrDr/skill_to_jobProfile_mappingrHrIrIrJ,map_skills_to_jobProfile_without_descriptions&!  rVc Csz'|d}|d}|dkr!|dkr!|||d}t|WStdWdStyA}ztd|WYd}~dSd}~ww)Nr(r*z#Could not find JSON object in text.z"Error extracting or parsing JSON: )findrfindjsonloadsr9r<)textstartendjson_strrHrIrIrJr:s   r:c Cs.tdtdd}tj|dd}g}|D] }|dd}|dd}|r-||d |q||qd |} tgd d d } | j| dd dd| dd dd|d } z$| | } | j } t d| t | }|durqWdS| jdd}W||fSty}zt d|WYd}~dSd}~ww)NrrrF ensure_asciirrr r!r")r#r$ mapped_skillsaw You are an expert in skill-to-job-profile mapping. Your task is to validate and refine a given mapping of skills to job profiles to ensure accuracy, completeness, and clarity. ### Input: - **Existing Mapped Skills** (JSON format): {mapped_skills} ### Available Skills: {skills_db} ### Job Profiles (with descriptions where available): {job_profiles} ### Output Format: {{ "Job Profile 1": ["Skill 1", "Skill 2", "Skill 3"], "Job Profile 2": ["Skill 4", "Skill 5"], "Job Profile 3": ["Skill 6", "Skill 7", "Skill 8"] }} ### Enhanced Mapping Guidelines: 1. **Leverage Job Descriptions:** - Use the provided job descriptions to better understand the role requirements. - Map skills that align with the specific responsibilities and expertise mentioned in descriptions. 2. **Ensure Relevance:** - Verify that each skill is appropriately mapped to the correct job profile(s) based on both the role name and description. - Remove any incorrectly assigned skills. 3. **Check for Completeness:** - Identify and add missing skills relevant to each job profile based on the description context. - For profiles without descriptions, use industry-standard expectations for that role. 4. **Refine Overlapping Skills:** - If a skill belongs to multiple job profiles, ensure it is correctly included in each where relevant. - Consider the description context to determine skill relevance. 5. **Improve Consistency & Clarity:** - Standardize skill naming to avoid duplicates with different names. - Use precise and industry-recognized terminology. 6. **Handle Profiles with/without Descriptions:** - For profiles with descriptions: prioritize skills that match the described responsibilities. - For profiles without descriptions: use standard industry expectations for that role title. 7. **Response Format:** - **ONLY return the JSON object without any explanations, comments, or additional text.** - **DO NOT wrap the JSON in code blocks (```json ... ```).** - Use the exact job profile names as provided in the input. r%r(r)r*r+r,r-r.r/r0)rr1r[dumpsr2r3r4rr5r6r7r8r9r:r;r<)r#r=rcr>formatted_mapped_skillsr?r@rr rArBrCrDrErFrGrHrIrIrJ"map_skills_to_jobProfile_non_emptysB    7  rfc Cstddd}tj|dd}tgddd}|j|d d d d |d d d d |d}z"||}|j}td |t |} | durFWdS|j d} W| | fSt yi} ztd| WYd} ~ dSd} ~ ww)NrMrNrOFrar#rRrca You are an expert in skill-to-JobProfile mapping. Your task is to validate and refine a given mapping of skills to JobProfile to ensure accuracy, completeness, and clarity. ### Input: - **Existing Mapped Skills** (JSON format): {mapped_skills} ### Input Skills: {skills_db} ### JobProfile: {JobProfile} ### Output Format: {{ "JobProfile 1": ["Skill 1", "Skill 2", "Skill 3"], "JobProfile 2": ["Skill 4", "Skill 5"], "JobProfile 3": ["Skill 6", "Skill 7", "Skill 8"] }} ### Validation & Enhancement Guidelines: 1. **Ensure Relevance:** - Verify that each skill is appropriately mapped to the correct JobProfile(s). - Remove any incorrectly assigned skills. 2. **Check for Completeness:** - Identify and add missing skills relevant to each JobProfile. - Ensure no important skills are overlooked. 3. **Refine Overlapping Skills:** - If a skill belongs to multiple JobProfile, ensure it is correctly included in each. - Avoid redundant mappings unless justified. 4. **Improve Consistency & Clarity:** - Standardize skill naming to avoid duplicates with different names. - Use precise and industry-recognized terminology. 5. **Handle Unmapped JobProfile:** - If a JobProfile lacks sufficient mapped skills, reevaluate and attempt to match relevant ones. 6. **Respond in Valid JSON Format:** - **ONLY return the JSON object without any explanations, comments, or additional text.** - **DO NOT wrap the JSON in code blocks (```json ... ```).** r%r(r)r*r+r,r-rSr0) rr[rdrr5r6r7r8r9r:rTr<) r#rRrcr>rerBrCrDrErFrGrHrIrIrJ6map_skills_to_jobProfile_non_empty_without_descriptionGs8,   rh__main__Infrastructurea} Budgeting, Cost Estimation, Civil Engineering, Structural Analysis, AutoCAD, Revit, Communication, Leadership, Teamwork, Urban Design, Water Supply and Distribution , SQL, C++ , Management, Housekeeping Management,Front Desk Management,Complaint Handling,Recruitment,Training & Development zZ HR, Developer, Manager, Planner,CEO, Infrastructure Deverloper ) zTime ManagementzDecision MakingIndustry TrendsSector ExpertiseBusiness AcumenStakeholder CommunicationRisk ManagementzAgile Methodologies LeadershipTeamwork Adaptability)Data EncryptionIncident ResponseCloud ArchitectureCloud MigrationCloud MonitoringNetwork SecurityProgramming LanguagesPy) NegotiationEmpathyrprormrlrkrn Creativity) r}rlr|rprnrormrkr{)rzrySoftware TestingVersion Control)rxrzryrsrt Communicationrn)r~rryrvrwrzru)ManagerEngineerCEO CO-Founder DeveloperSenior DeveloperzHR HeadProduct Engineer)rrrrrrrOPOLKLrg)rLr)?ostimerandomrer[requestslangchain_community.embeddingsr langchain_community.vectorstoresrlangchain_core.promptsrcrawl4airasynciolangchain_groqrrlangchain_core.output_parsersrr langchain_core.runnablesr $langchain_community.document_loadersr r r rPyPDF2r$langchain_experimental.text_splitterrpydanticrrtypingrrr urllib.parserlangchain_ollamarshutilr1 OLLAMA_MODELrKrVr:rfrh__name__industryskillsetrRmappedrcrd json_datar9 skill_treerGtyperIrIrIrJs            m>i s    K      L