o iT@sdZddlmZmZddlmZddlmZmZm Z ddl m Z m Z ddl Z ddlZddlZddlZddlZddlmZmZddlZddlmZmZdd lmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*dd l+m,Z,dd l-m.Z.ej/ej0d d e1e2Z3eddddZ4dZ5ej6e5dde4j7dee5dddGdddeZ8GdddeZ9ddZ:dd Z;e4e4?d'd(e8d)ed*e fd+d,Z@e4?d-d)e9d*e fd.d/ZdS)0a ================================================================================ Complete FastAPI Application for Storigo Content Generation - v7.0 - Professional slide content generation with inline image fetching - Guaranteed image field presence (URL or null) - Comprehensive error handling and logging - Multiple endpoints support ================================================================================ )FastAPI HTTPException) StaticFiles) BaseModelField validator) JSONResponse FileResponseN)UnionDict)RequestBody)load_pdf transcribeload_txt split_text_with_semantic_chunker crawlerrr read_file_url(split_text_with_semantic_chunker_for_urlclean_using_llmcount_total_wordssave_documents_to_txtcreate_and_save_embeddingsgenerate_slide_contentmerge_all_faissparsingmarks_splitterallocate_slidescreate_embeddingsgenerate_slide_content_alloc1)"generate_slide_content_from_prompt)OllamaEmbeddingsz7%(asctime)s - [%(levelname)s] - (FastAPI) - %(message)s)levelformatStorigo Content Generation APIzNProfessional API for generating presentation content with images using Groq AI7.0.0)title descriptionversiongenerated_images_for_storigoT)exist_okz/images) directoryimages)namec@sxeZdZUdZeed<eed<eed<eeefed<eeefed<eed<eed<eeefed <Gd d d Z d S) StorigoContentRequestz1Request model for prompt-based content generation client_idprompt num_slidesis_image is_questionnum_mcqsquestion_positionisGPUc @s&eZdZdddddddddd iZd S) zStorigoContentRequest.Configexamplez;Generate a professional presentation about kitchen handling endT)r/r0r1r2r3r4r5r6N__name__ __module__ __qualname__json_schema_extrarBrBX/var/www/eduai.edurigo.com/image_generation/testing/image_generation_fast_api_testing.pyConfigGsrDN) r>r?r@__doc__int__annotations__strr boolrDrBrBrBrCr.<s r.c@seZdZUdZeed<eed<eed<eeefed<eed<eeefed<eed<eed <eeefed <Gd d d Z d S)DocumentContentRequestz3Request model for document-based content generationr/r1 document_urlr2 document_typer3r4r5r6c @s(eZdZdddddddddd d iZd S) zDocumentContentRequest.Configr7 client_123r9z https://example.com/document.pdf1pdfr;r<T) r/r1rKr2rLr3r4r5r6Nr=rBrBrBrCrDasrDN) r>r?r@rErHrGrFr rIrDrBrBrBrCrJUs rJc Csbztj|dd}|jdkr|jWStdd|dty0}z tddt|dd }~ww) zFetch document from URL)timeoutizDocument not found at  status_codedetailzError fetching document: N)requestsgetrTcontentr ExceptionrH)urlresponseerBrBrCfetch_document_with_curlts r^c Csz't||t|}t||||||||} td|d| } t| dWStyS} z tdt | tdt | t dddWYd } ~ Sd } ~ ww) z'Process documents and generate responsezSlide content generated for z slides.rYzError generating content: Error: errordetailsrVrYrTN) rrrloggerinfodictrrZrbrH traceback format_exc) split_documentsr/r1r4r2r3r5r6merge_embeddings slide_content response_datar]rBrBrCprocess_and_generate_responses$  rn/cs ddddddddgd d S) zAPI information endpointr$r% operational%/generate-storigo-content-from-prompt/generate-storigo-content/healthz/images/{filename})generate_from_promptgenerate_from_documenthealthr,)z3Professional slide content generation using Groq AIz4Inline synchronous image generation (no null values)z,MCQ generation with customizable positioningz,Document-based content generation (PDF/HTML)z(Comprehensive error handling and loggingzStatic image serving)r-r(status endpointsfeaturesrBrBrBrBrCrootsrzrscsddtddS)zHealth check endpointhealthyr%z)Storigo Content Generation API is running)rwr( timestampmessage)timerBrBrBrC health_checks rrqpayloadrequestreturnc sZzjtdtdtdtdtd|jtd|jdddtd |jtd |jtd |jtd |jtd |jtdt |jt rl|jdk}nt |jt rz|j dv}nt |j}td|dtdt fdd}||d}td|t}t|j|j|j|t |j|jt |jt rt |jn|jd}t|}td|ddtdtdtdit|ddd}|jD]k\} } t| dr| j| j| j| jd|d | <qt| d!d} | dur@t |  } | r#| d"kr&d} n| d#r1|| } n| d$s=| d%r>nd} | jt| d&dt| d'dt| d(d| d)|d | <qtd*td+d,|d D} td-d,|d D} d.}d.}|d D]@\}}|d/rd!|vrtd0|d1q|d!r|d7}td2|d3|d!q|d7}td4|d5qtdtd6td7|ddtd8t |d td | td | |r| d.krtd9|td:|td;|| d<d=d>td?|dtdg}|d D]\}}|d/rEd!|vrE|!|q1|r\td@t |dAt"dB|tdCtdDt#|dEdFWSt$y}z3tdtdGtdHt |tdtt%&t#t |t%&dIdJdFWYd}~Sd}~ww)Kz Generate professional Storigo content from a text prompt with inline image generation. Returns JSONResponse where every slide has an 'image' field (absolute URL or null). P================================================================================u8🚀 API ENDPOINT: /generate-storigo-content-from-prompt📋 Request Parameters: - Client ID: z - Prompt: NPz... - Slides: - MCQs: z - Images: z - Questions: z - Question Position: r:)rNtrueTrueyesu🎨 Image generation enabled: reqrcSs|jd}|jd}|r)|r)|dd}|dd}|d|S|jd}|r:|jjd|St|jdS)Nzx-forwarded-protozx-forwarded-host,rz://hostro) headersrXsplitstripr[schemerHbase_urlrstrip)rforwarded_protoforwarded_hostprotorrBrBrC_compute_base_urls   zHgenerate_storigo_content_from_prompt_endpoint.._compute_base_urlrou#🌐 Computed base URL for images: )r0r1r4r2r3r5GPUu⏱️ Total generation time: z.2fsu📦 PREPARING API RESPONSE token_count)slidesrquestion)typeroptionscorrect_answerrimagenonez/images/zhttp://zhttps:// subheading paragraphsvisualization_suggestion)rrrrru🔍 Response Validation:cs|] }|drdVqdS)slide_r:N startswith.0krBrBrC :z@generate_storigo_content_from_prompt_endpoint..csr)mcq_r:NrrrBrBrCr;rrru❌ CRITICAL: z missing 'image' field!u ✅ z : image = u ⚠️ z: image = nullu📊 RESPONSE SUMMARY:z - Generation time: z - Total items: z - Images assigned: z - Images null: z - Success rate: dz.1f%z - Token count: u❌ CRITICAL ERROR: z slides missing 'image' fieldz,Internal error: slides missing image field: u4✅ Response validation passed - returning to clientQ================================================================================ rRrdu❌ API ENDPOINT ERRORr`rarV)'rerfr/r0r1r4r2r3r5 isinstancerFrHrrIr rr~r r6getattrritemshasattrrrrrlowerrsumkeysrblenappend ValueErrorrrZrhri)rr is_image_boolrrgeneration_startstorigo_contentgeneration_timerm slide_key slide_obj image_value total_slides total_mcqsimages_assigned images_nullkeydatamissing_image_fieldr]rBrBrC-generate_storigo_content_from_prompt_endpoints                                    rrrc sztdtdtdtdtd|jtd|jtd|jtd|jtd|jtd|jd kr>td td |jt|j}td t|d t j ddd}| ||j }td|Wdn1swYzt |}tdddd }| |Wdn1swYddg}tdddd }|}Wdn1swYt||}tdt|dt||jdd} t||j} t|| |j|j|j|j|j|j} | } tdtdt| d Wtj|r)t|td!WSWStj|r=t|td!ww|jd"krtd#td$|jd%|jvr|td&t|j} t d'd(} t!| }t"|| }t#|}t$|| }n5td)t%|jIdH}td*|t&|}|st'd+d,d-t#|}td.t d'd(} t$|| }td/t(||j|j|j|j|j|j|jWSt'd0d1d-t'yt)y }z't*d2t+|t*t,-td3t+|t,-d4d+d5WYd}~Sd}~ww)6a Generate Storigo content from document URL (PDF or HTML) This endpoint processes documents and generates presentation content: - PDF documents with text extraction - HTML content from web pages - YouTube video transcriptions - Semantic chunking and embeddings Args: request: DocumentContentRequest with document URL and configuration Returns: JSONResponse with slides and optional MCQs ru,🚀 API ENDPOINT: /generate-storigo-contentrrz - Document URL: z - Document Type: rrrOu📄 Processing PDF document...z Fetching from: u ✅ Document fetched: z bytesFz.pdf)deletesuffixu 📁 Temporary file: Nz parse_data.mdwzutf-8)encoding)#zHeader 1)z##zHeader 2ru ✅ Split into z chunksr) min_charsu✅ Content generation completerr_u% 🗑️ Cleaned up temporary filehtmlu🌐 Processing HTML content...z URL: youtubeu0 📹 YouTube video detected - transcribing...znomic-embed-text)modelu 🕷️ Crawling web page...u ✅ Content saved to: rVzFailed to read content from URLrSu# ✅ Extracted meaningful contentu6 🔄 Processing documents and generating content...iz/Unsupported document_type. Use 'pdf' or 'html'.u"❌ Error in document processing: r`rard).rerfr/rKrLr1r4r^rtempfileNamedTemporaryFilewriter-ropenreadrrrrr2r3r5r6rgrospathexistsremoverrr!rrrrrrrrnrZrbrHrhri)rdocument_content temp_filetemp_file_path parse_datafheaders_to_split_onrYchunks allocation embeddingsrlrm file_pathtextsplit_documents1meaningful_contentrjfilename raw_contentr]rBrBrCgenerate_storigo_contentws                                    r)ArEfastapirrfastapi.staticfilesrpydanticrrrfastapi.responsesrr rrWrloggingrhtypingr r r~r r rrrrrrrrrrrrrrrrrrr$generate_storigo_content_from_promptr langchain_community.embeddingsr! basicConfigINFO getLoggerr>reappIMAGES_DIR_NAMEmakedirsmountr.rJr^rnrXrzrpostrrBrBrBrCs` P        :