o th@sddlZddlZddlmZmZmZddlmZddlm Z ddl m Z ddl m Z ejejdeeZeGdd d ZeGd d d ZeGd d d ZGdddZddZedkreedSdS)N)DictListOptional) dataclass) ChatOllama)PromptTemplate) HumanMessage)levelc@s:eZdZUdZeed<eed<eed<eed<eed<dS)Coursez!Data class for course information course_idnameshort_description descriptionskillN)__name__ __module__ __qualname____doc__str__annotations__rrE/var/www/eduai.edurigo.com/doc_train/edurigo_ai/TNA/testing/tester.pyr s  r c@s2eZdZUdZeed<eed<eed<eed<dS) CourseMatchz(Data class for course match with scoringr course_namematch_percentagereasonN)rrrrrrintrrrrrs  rc@sFeZdZUdZeed<eed<eed<eeed<eed<eed<dS) DomainFilterResponsez.Data class for domain-aware filtering responsedomain field_prompttotal_courses_inputcourse_matchestotal_matching_coursesprocessing_summaryN) rrrrrrrrrrrrrrs   rc @seZdZdZd#dedefddZdeed e eeeffd d Z d ed edeed e fddZ d ed edeeded ee f ddZdeed efddZdedeed ee fddZded efddZdedeed ee fddZded efd d!Zd"S)$DomainAwareCourseFilterz2Domain-aware course filtering using LLM in batches gemma3:12b model_name batch_sizec Csbzt|dddd|_||_td|d|dWd Sty0}z td|d }~ww) z)Initialize the domain-aware course filterig?i )modelnum_ctx temperature num_predictz3Domain-Aware Course Filter initialized with model: z (Batch size: )z1Failed to initialize Domain-Aware Course Filter: N)rllmr(loggerinfo Exceptionerror)selfr'r(errr__init__+sz DomainAwareCourseFilter.__init__coursesreturncCstdt|d|dfS)z*Keep all courses - no aggressive filteringz$Using all courses without cleaning:  coursesr)r/r0len)r3r6rrrclean_course_data:sz)DomainAwareCourseFilter.clean_course_datarrcCszt|}||\}}g}g}t||jd|j} tdt||jD][} || | |j} | |jd} td| d| d| ddt| |jt||||| | } || | d| dt| d t| d td| d t| d q%|j d dddd| dd |}t ||||t||d}td|dt|d |WSt y}ztd|t ||t|gddt|dWYd}~Sd}~ww)a Main method: Filter courses using domain-aware LLM analysis in batches Args: domain: The identified domain (e.g., "Technology", "Business", "Healthcare") field_prompt: The specific field (e.g., "Frontend Development", "Sales Training") courses: List of all courses to filter Returns: DomainFilterResponse with matched courses and details rzProcessing batch /z : courses -Batch z: z matches from r8z results: z matchescSs|jSN)r)xrrrgszBDomainAwareCourseFilter.filter_courses_by_domain..T)keyreversez Processed z batches. z | )rrr r!r"r#zFinal results: u → z!Error in domain-aware filtering: zError in filtering: N)r9r:r(ranger/r0min_analyze_batch_with_domainextendappendsortjoinrr1r2r)r3rrr6original_countcleaned_courses removed_count all_matchesbatch_summaries total_batchesibatch batch_num batch_matchesr#responser4rrrfilter_courses_by_domainAsL 6 &  z0DomainAwareCourseFilter.filter_courses_by_domainrRrSc Cs||}tgddd}z+|j||||d}|jt|dg}||j|} t d|dt | d| WSt yW} zt d|d | gWYd } ~ Sd } ~ ww) z8Analyze a batch of courses using LLM with domain context)rr courses_textrSa You are an EXPERT course curator specializing in the {domain} domain. DOMAIN: {domain} TARGET FIELD: {field_prompt} BATCH: {batch_num} TASK: Analyze each course below and determine if it's relevant for someone seeking "{field_prompt}" skills in the {domain} domain. EVALUATION CRITERIA: 1. Course content directly relates to {field_prompt} 2. Skills taught are applicable in {domain} field 3. Course would help someone working in or entering {field_prompt} 4. Content is professional-level, not basic computer literacy SCORING GUIDE: - 90-100%: Perfect match, essential for {field_prompt} - 80-89%: Very relevant, directly applicable - 70-79%: Somewhat relevant, useful supporting skills - Below 70%: Not relevant enough to recommend COURSES TO ANALYZE: {courses_text} RESPONSE FORMAT: Return ONLY a JSON array with this exact structure: [ {{ "course_id": "123", "course_name": "Exact Course Name", "match_percentage": 95, "reason": "Specific reason why this course matches {field_prompt}" }} ] IMPORTANT: - Only include courses with match_percentage >= 70 - If no courses meet the criteria, return an empty array: [] - Be selective and strict in your evaluation - Ensure course_name matches exactly as provided )input_variablestemplate)contentr>z: LLM identified z matching courseszError in batch z LLM analysis: N) _format_batch_for_llmrformatr.invoker_parse_batch_responserZr/r0r9r1r2) r3rrrRrSrWprompt_templateformatted_promptrUmatchesr4rrrrFs* ,z2DomainAwareCourseFilter._analyze_batch_with_domaincCsg}|D]A}d|jd}|d|jd7}|jr(|j|jkr(|d|jd7}|jr4|d|jd7}|jr@|d|jd7}||qdd|dS) z'Format a batch of courses for LLM inputzID:  zName: zShort Description: z Description: zSkills: z3 ==================================================z2==================================================)r r r rrrHrJ)r3rRcourses_formattedcourse course_inforrrr[s z-DomainAwareCourseFilter._format_batch_for_llmresponse_contentoriginal_batchc CszDddl}|d||j}|r>t|}g}|D] }||r:tt|d|dt |d|dd}| |q|WS| ||WStj ye} zt d | | ||WYd} ~ Sd} ~ wty} zt d | gWYd} ~ Sd} ~ ww) z,Parse LLM response to extract course matchesrNz\[.*\]r rrrr rrrzJSON parsing failed: zError parsing batch response: )researchDOTALLjsonloadsgroup_validate_match_itemrrrrH_fallback_parse_batch_responseJSONDecodeErrorr/warningr1r2) r3rfrgri json_matchparsed_responseraitemmatchr4rrrr^s6    z-DomainAwareCourseFilter._parse_batch_responseruc Csbgd}|D] }||vrdSqzt|d}|dks|dkr"WdSWdSttfy0YdSw)z2Validate that a match item has all required fieldsrhFrFdT)r ValueError TypeError)r3rurequired_fieldsfield percentagerrrros z,DomainAwareCourseFilter._validate_match_itemc sLg}|D]}|jvr#tfdddDr#|t|j|jdddq|S)z+Fallback parsing when JSON extraction failsc3s|] }|vVqdSr?)lower).0positiverfrr s  zIDomainAwareCourseFilter._fallback_parse_batch_response..)relevantrvgoodsuitable recommendKz5Identified as relevant through fallback text analysisrh)r anyrHrr )r3rfrgrardrrrrpsz6DomainAwareCourseFilter._fallback_parse_batch_response json_datac Cszzt|}|dd}|dd}|r|sddgdWS|dg}g}|D]&}tt|dd|d d|d d|d d|d dd }||q'||||} g} | jD]} | | j| j | j | j dqZd| j | j | j| | j| jdWStjy} ztd| dd| gdWYd} ~ Sd} ~ wty} ztd| dt| gdWYd} ~ Sd} ~ ww)z Process JSON request and return JSON response Expected input format: { "domain": "Technology", "field_prompt": "Frontend Development", "courses": [...] } rrFz)Both domain and field_prompt are required)successr2r!r6r rcourse_short_descriptioncourse_descriptionr)r r r rrrhT)rrrr r!r"r#zJSON decode error: zInvalid JSON format: NzProcessing error: )rlrmgetr rrHrVr!r rrrrrr r"r#rqr/r2r1) r3r request_datarr courses_datar6 course_datardfilter_responsecourse_matches_jsonrvr4rrrprocess_json_request(sh            z,DomainAwareCourseFilter.process_json_requestN)r%r&)rrrrrrr5rr tupler:rrVrrFr[r^dictboolrorprrrrrrr$(s"&BE$r$c Cs: gddddgdddddgdd d d dgdd d d dgdddddgdddddgdddddgdddddgdddddgddddddd d!d"d#d d$d"d%d d&d"gdd'd(d)d*gdd+d,d-dgdd.d/d/dgdd0d1d1dgdd2d3d3dgdd4d5d6dgdd7d8d8d9gdd:d;dd?dgdd@dAdAdgddBdCdCdgddDdEdFdgddGdHdHdgddIdJdKdgddLdMdMdgddNdOdOdgddPdQdRdgddSdTdUdgddVdWdWdXdYd dZd"d[d d\d"gdd]d^d^dgdd_d`dadgddbdcdcdgddddedfdgddgdhdhdgddidjdjdgddkdldWdgddmdndndgddodpdhdgddqdrdjdgddsdtdtdgddudvdvdgddwdxdxdgddydzdzdgdd{d|d|dgdd}d~ddgdddddgdddddgddddKdgdddddgdddddgdddddgdddddgdddddgdddddgdddddgdddddgdddddgdddddgddddKdgdddddgdddddgdddddgdddddgddddKdgddddKdgddddKdgddddKdgdddddgdddddgdddddgdddddgdddddgdddddgdddddgdddddgddddzdgdddddgdddddgdddddgddddddd dd"gdddddgddddddd dd"dd dd"dddd"gdddddgddddKdgdddddgdddddgdddddgdddddgdddddgdddddgdddddgdddddgdddddgdddddgddddddd dd"gdddddgdddddgddddddd dd"gdddddgddd d dgdd d dKdgdd d ddgdddddgdddddgdddddgdddddgdddddgdddddgdddddgdd d!d"dgdd#d$d$dgdd%d&d&d'gdd(d)d)dgdd*d+d+dgdd,d-d-dd d.d/d"gdd0d1d2dgdd3d4d4dd d d/d"d5d.d6d"gdd7d8d8dgdd9d:d:dgdd;d<d<dd>dgdd?d@d@d@gddAdBd@d@gddCdDdDdDgddEdFd@d@gddGdHd@d@gddIdJdKdgddLdMdKdgddNdOdOdgddPdQdRddSd dTd"gddUdVdWddd dXd"gddYdZdZdgdd[d\d\dgdd]d^d\dgdd_d`d`ddd dXd"gddadbdcdgddddedcdgddfdgdOdgddhdidRddSd dTd"gddjdkdWddd dXd"gddldmdWddd dXd"gddndod`ddd dXd"gddpdqdqdgddrdsdsdgddtdududgddvdwdudgddxdydydgddzd{d{dgd}d|d}d~ddd~d|dd~g}tdtdd}|D]}tddtd|dd|dtd|d|d|d}|t|}td|dtdtd|dtd|dtd|dD])}td|dtd|ddtd|dtqR|dstd|dtd|dqdS(z&Test the domain-aware filtering system33zCurrent Affairsr)r rr rskills35zFI-Lead A leadership Development Intervention for Emerging Markets teamzGLeadership Development intervention for emerging markets team at EmcurezI-Lead Program was designed to support the Emerging Markets team Leaders at Emcure Pharmaceuticals to develop specific leadership competencies and to take their performance to the next level in achieve desired business goal.43z)Python Programming for Complete Beginners49zSales MasterClassz!A complete Sales Training ProgramzToday's selling environment is tough, and only getting tougher. The old tactics are no longer working, and the current economy is only making selling more difficult. You need sales tactics and strategies that work now and work fast.59zCodeigntier Beginner86zJava For BeginnerszLorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's standard dummy text ever since the 1500s.360z Scorm Set-1zSet- 1367Scorm374zProduction test 9-6-22zProduction Test408zCourse for Learning pathzCourse GFor Learning path2851zManager Level 1)skill_id skill_type skill_name284 Wicketkipper283Boller426zLearn Spoken Englishz!Learn to speak English in 90 dayszThis is a 60 days self paced course. It consists of more than 3 hours of video lectures, more than 2 hours of reading material and hundreds of interesting questions.476 Inductiontraining485zNew Scorm Course496zScorm Course Test503zScorm Server Test505zScorm Posh Coursez InfoSec Posh513zScorm Info SecurityzMiami-Dade County's partnership with OBE Power is providing electric vehicle (EV) charging as a service to parking patrons at key locations throughout the County's public garages in Downtown Miami.536zassesment test assesment544zOnly Classic quizquiz554z$Course for testing direct coure 100%562zNew Assessment for Infobeans565z Video testingvideo570zCultural Pillars599z All resoursesAll616z3CODE OF CONDUCT, ANTI-BRIBERY AND CORRUPTION POLICY650zISO Test656z/New Course For Production build testing 20-7-23zProduction Build657zReminder Test For CourseReminder673zDeveloping Digital EtiquettezIn today's digital world, the way we communicate online matters more than ever. Developing Digital Etiquette is designed to help you navigate virtual interactions with professionalism, clarity, and respect.1544zDigital Marketing Strategy1540zRobotics Engineering683zStorage System684zModule Lock Testz Modul Test700z Course Lock710zCourse Flow Check Same As KCKC711zAscent UK B2B Test712zAscent USA B2B Test715z'Developing Digital Etiquette- Cycle - 1718zMaterial Handeling Equipments725z'Advance - Ascent UK B2B Test- Cycle - 1726zAdvance - Ascent USA B2B Test730zCommunicating with impact733zTest Stream Upload file735Intrapreneurship765r 790zAdvance Level Communication795zTrainer create a coursezTrainer course805zCoad of Conduct 23-24z23 -24810zPOSH and INFO SECKINFO845z All Content851zSection ExportSection852zCourse New create test857zDeveloping People at Workz#Learn how to develop people at workzPeople feel valued when the organizations they work for care for their development. This course is designed to give you a lens through which you can assess the developmental needs of your Team members.900z Dock Ack TestDock914zPosh for Bloom (neha)Bloom915zManager Course- MangeshMangesh936zMechanical Demo977zTest course 15-5-2024zTest course 14/05/241000zThe Five Dysfunctions of a team1017zThe Art of CoachingzQA step by step approach to initiate coaching conversations with your Team Membersa This course aims to introduce the Art of Coaching to managers and leaders who wish to take that extra step to develop their Team Members. Coaching is often misunderstood because we witness it from a perspective where the coach is pushing and telling people what to do.1026zAll resourses- Cycle - 2uकार्यस्थल में महिलाओं के यौन उत्पीड़न का निवारण1048 Assignment1059z POSH Hindi1081ExtcDemo1084zLearning Path course 1Lp11085zElectrical Engineering1090zElectrical Vehical1101 Mechanical1131zCommunication Skill1132z Demo Course1158z Dis Function51182z Report Test1188zEmail Etiquitee Scorm Web1189zStress Management1248z"Course reference matrial acknoldge1278zNICPL & HR Induction1288zAssignment TestTest1293zCoursera Course1298zAssignment One1304zBGSS Demo Course 1one1305zTime Spent course Onez Time spent1350981Ancibel1360z!Time Spent course One - Cycle - 11376zCleanmax RequirementzMultimodule Support282Batsman9723Linux1377zMultiple Scorm in one module1378zAll resourses for testing1388zManager feed BackzManager Feed Back1389zAdvance Feedback Test1411z Advance Feedback Test- Cycle - 31415z BGSS Demo1424z+Advance Feedback Test- Cycle - 3- Cycle - 11426z Midland DemozEdurigo empowers managers with powerful tools to seamlessly track their team's progress. Tabs like Courses, Programs, Assessments, and StoriGo provide instant visibility into completion statuses.1435zAdvance Feedback Testing1438z#Advance Feedback Testing- Cycle - 21446z.Advance Feedback Testing- Cycle - 2- Cycle - 11447zWeeak ly Course1455zAssignment Test- Cycle - 11456z HR Course 1Hr1457zupload assignment course test1458zAssignment Test-for new device1469z(upload assignment course test- Cycle - 11476m11481zAll Content- Cycle - 11498z!Frontend Development - HTML & CSSz#Introduction to HTML and CSS basics1499z!Frontend Development - JavaScriptzIntroduction to JavaScript (JS)1500zFrontend Development - ReactJszIntroduction to ReactJs1505v11510zAll resource coursezAll Resource course1562z Scorm 1 vedakzScorm 11572z iframe video15771591z Video Testv1597zVijaysales Demo1616z Handling Difficult Conversationsz=Track and calculate average learning hours per user annually.1628zMidland Use Case1636zHR Induction Course1649z Demo Nirmal2zActive Listening1991zANgular BasicszANgular Basicss1668zfunctional demo1342zBig Data Analysis1669zCourse test without badges1674zLock seeak bar1675zhide seek bar testing1676zTwo Bagje Only1677z badge test1678zbadge test- Cycle - 11679z badge test 21680zbadge test- Cycle - 21681z badge test- Cycle - 2- Cycle - 11682zAssignment Flow testzAssignment flow test1683zAssignment test1685zSingle Badge With Single roul1686z1Single Badge: Completion by first set of learnersz#Completion by first set of learners1599zBlockchain Security Measures1687z/Single Badge : Score exceeds defined percentagez Score exceeds defined percentagezAccounting and Auditing1688zSingle Badge : With 2 Quiz1689z Completion before specified date1690z+Completion before specified date- Cycle - 11691z@3 Badge : Score exceeds defined percentage : diffrant percentage1692z,Single Badge With Multipal Roul Or conditionzSingle Badge With Multipal Roul1693z-Single Badge With Multipal Roul AND condition1694z)Single Badge With Single roul: API Change1695z>Single Badge: Completion by first set of learners : API Change1696z:Single Badge : Score exceeds defined percentage- Cycle - 21697zESingle Badge : Score exceeds defined percentage- Cycle - 2- Cycle - 11698zK3 Badge : Score exceeds defined percentage : diffrant percentage- Cycle - 11700z All Resource1701zZero Point Course1702zNew One1703zNew One- Cycle - 11704zDecision Making1705zTime and Stress Management Technologyz I want to improev my tech skills)rrBusinesszSales Trainingz'I want to improve only my python skillsz*=== TESTING DOMAIN-AWARE COURSE FILTER ===r&)r(rbz<============================================================z TESTING: rz - r)rrr6u ✅ SUCCESS: ru 📊 STATS:z Input courses: r z Final matches: r"u 🎯 COURSE MATCHES:r!u 📋 rz Match: r%z Reason: rz No matches found for u📝 Processing: r#N)printr$rrldumps) test_courses test_cases filter_system test_case test_requestresultrvrrrtest_domain_aware_filteringxs8 %,3:AX_fmt{ &-4;BIPWipw~ ")07>ELSZahov} !(/6=DKRY`gnu|  '.5<CJW^u|  '.5<CJW^ery$+29@GNU\cpy !(/6=DKRY`mz $+2?LYfmt{  $     rh__main__)rlloggingtypingrrr dataclassesrlangchain_ollamarlangchain.promptsrlangchain.schemar basicConfigr getLoggerrr/r rrr$rhrrrrs>      RJ