post cover image

[Completed] SDS CP #19 - Local AI Writing Assistant

Project Overview

The AI Local Writing Assistant is a Generative AI application designed to assist with creative writing tasks such as crafting LinkedIn posts, writing company brochures, and creating short stories. This project will use Ollama to download and run a lightweight Large Language Model (LLM) locally. The app will feature a Gradio-based user interface to make it accessible for beginners while allowing advanced users to extend its functionality. The final app will be deployed on Hugging Face Spaces.

Project Objectives

  • Local Model Setup: Use Ollama to download and run a lightweight LLM locally, ensuring offline accessibility and cost efficiency.

  • Creative Writing Assistant: Build functionality for different writing tasks, such as LinkedIn posts, marketing content, and storytelling.

  • Interactive User Interface: Develop a user-friendly UI using Gradio for interacting with the LLM.

  • Flexible Deployment: Deploy the app on Hugging Face Spaces for easy sharing and public access.


Workflow

Phase 1: Local Model Setup (Ollama)

  • Install Ollama and download a lightweight LLM.

  • Test basic interactions with the LLM locally.

Phase 2: Backend Development

  • Build chat functionality.

  • Implement writing assistant functions:

    • Short Story Creator (Level 1).

    • LinkedIn Post Generator (Level 1).

    • Brochure Writer (Level 2).

  • Use prompt engineering for flexible outputs based on tone and length.

Phase 3: Frontend Development

  • Build an interactive Gradio interface with:

    • Dropdowns for writing modes (Level 2).

    • Text inputs for custom prompts.

    • Outputs displaying the generated content.

Phase 4: Deployment

  • Push the Gradio app to Hugging Face Spaces for public access.


Link to GitHub: https://github.com/SuperDataScience-Community-Projects/SDS-CP019-local-ai-writing-assistant

Post a comment