o fhC:@s*ddlZddlZddlZddlmZddlmZmZmZddl Z ddl Z ddlZddl m Z m Z mZddlmZeeZdded efd d Zded efd dZddedefddZdefddZdded efddZded e e eefdffddZddedefddZddlmZdefddZdS) N) GROQ_API_KEY)perform_web_searchget_search_summaryget_structured_search_results)AsyncGeneratorDictAny) BeautifulSoupquerysearch_contextc Cszd}dtdd}|}|rd|d|d}dd d d |d gd d dd}td|tdt|tj|||dd}td|j|jdkrw|}d|vrot|ddkro|dddd}|WSt dWdSz|} | di dd} t d| d| WWSd |jd!|j YWSt y} zt d"t | d#t | WYd$} ~ Sd$} ~ ww)%z5 Query Groq API with optional search context /https://api.groq.com/openai/v1/chat/completionsBearer application/json Authorizationz Content-Typen Based on the following search information and user query, provide a comprehensive response: Search Context:  User Query: Please provide a detailed, helpful response that incorporates relevant information from the search context while directly answering the user's question. systemYou are a helpful AI assistant. When provided with search context, use it to enhance your responses while ensuring accuracy and relevance.rolecontentuserz gemma2-9b-itffffff?)messagesmodel temperature max_tokensz API URL: zEnhanced query length: headersjsontimeoutzResponse status: choicesrmessagerzNo choices found in responsezNo response generatederrorz Unknown errorzGroq API error details: zGroq API Error: API Error : zException in query_groq: Exception: N)rloggerinfolenrequestspost status_coder%stripr*gettext Exceptionstr) r r urlr$enhanced_querydataresponse response_jsonr) error_data error_msgerA]/var/www/eduai.edurigo.com/doc_train/edurigo_ai/my_career/testing/advanced_chatbot/chatbot.py query_groqs\     rCreturncs&gd}|tfdd|DS)z< Determine if a query would benefit from web search )currentlatestrecentnewstodaynowweatherstockpriceupdatetrendingzwhat iszwho iszwhen didzwhere iszhow tobesttopcomparevsversus differencetutorialguidelearnexplainc3s|]}|vVqdS)NrA).0 indicator query_lowerrArB csz should_search..)lowerany)r search_indicatorsrAr\rB should_searchVsrbT enable_searchcCstd|d|r|dkrdStsdSttdkr%dttdStd td dd d}|r]t|r]td t|d d}|r]t|dkr]d|}tdt|dt||S)z@ Generate response with optional web search integration z&Generate response called with query: ''r Please provide a valid question. GROQ_API_KEY not found in config $GROQ_API_KEY seems invalid (length: )Using API key: N...*Query identified as benefiting from search num_resultsr Search context gathered: characters) r.r/r4rr0rbrjoinrC)r rcr search_resultsrArArBgenerate_responsees       rucCstd|d|r|dkrdgfSg}t|r1tdt|dd}tdt|d d}|rDt|d krDd |d d }t||}||fS)zV Generate response and return both the response and search results separately z2Generate response with search results for query: 'rdr rePerforming web search...rnSearch completed. Found  resultsrrpNrm)r.r/r4rbrr0rsrC)r rtr ai_responserArArB%generate_response_with_search_resultss   r{c Csz3d}dtdd}|}|rd|d|d}dd d d |d gd d ddd}td|t4IdH}|j|||dd4IdH}|jdkr|IdH}td|jd|d|jd|V WdIdHWdIdHWdSd} |j d2zz3dHW} | | d7} d| vr| dd\} } | } | dr| dd} | dkrWdIdHWdIdHWdS| rz&t| } d| vrt| dd kr| dd d!i}d"|vr|d"VWn tjyYqwd| vsq6WdIdHn 1IdHswYWdIdHWdS1IdHs.wYWdSty[}ztd#t|d$t|VWYd}~dSd}~ww)%z0 Query Groq API with streaming response rrrrrrrrrrrzllama3-8b-8192rrT)rrr r!streamz Starting streaming API call to: Nr"r#r'r+r,r zutf-8rprzdata: z[DONE]r(rdeltarz Exception in query_groq_stream: r-)rr.r/aiohttp ClientSessionr2statusr6r*r iter_chunkeddecodesplitr4 startswithr%loadsr0r5JSONDecodeErrorr7r8)r r r9r$r:r;sessionr< error_textbufferchunklinedata_strdata_objr~r@rArArBquery_groq_streams        ,4!rc Csltd|d|r|dkrdddVdSg}g}t|rltdt}|dt|d IdH}g}t|d D]\}}|d |d d |d}| |q=tdt |dt |dd||dVd}|rg}t|ddD]!\}}| d|d d| ddd| ddd|dqzd |}t ||2z 3dHW} d| dVq6dS)z Generate streaming response and return both the response chunks and structured search results Updated to match the non-streaming method's search result structure zs(   G"Q: #