This month we look at Generative AI, including a bit of history, opening the pandoras box, how they work and how they compare. Will include a demo or two.
If you aren’t a member, it’s free to join here https://u3acommunities.org/subscribe-to-computing-forum/.
This is (approximately) a repeat of the talk from 12 months ago … I thought it would be useful to re-visit since over the 12 months we’ve got quite a few new members and 12 months is a long time in Generative AI!.
Plenty of time is reserved for discussions.
18th March 2025 at 3pm UK
The slides were :
The recording was :
The references were :
- Discussion forum – https://u3acommunities.org/forums/topic/generative-ai/
- Attention is all you need – https://arxiv.org/abs/1706.03762
- LLM Visualization – https://bbycroft.net/llm
- Ollama – https://github.com/ollama/ollama
- OpenSource models – https://huggingface.co/
- Word vectors – http://vectors.nlpl.eu/explore/embeddings/en/associates/
- Leader board – https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
- Hints & tips – https://aibusiness.com/nlp/meta-6-tips-to-improve-your-prompts-for-llama-2
- ARC – https://www.kaggle.com/c/abstraction-and-reasoning-challenge
- GSM8K – https://paperswithcode.com/sota/arithmetic-reasoning-on-gsm8k
- Sparks of Artificial General Intelligence – https://arxiv.org/pdf/2303.12712.pdf
- Prompt engineering – https://en.wikipedia.org/wiki/Prompt_engineering
- List of models – https://lifearchitect.ai/models/
- AI vs Human – https://lifearchitect.ai/iq-testing-ai/
- Include references – https://jamesg.blog/2023/04/02/llm-prompts-source-attribution/
- Uncensored model – https://erichartford.com/uncensored-models
- GPT-2 in excel – https://arstechnica.com/information-technology/2024/03/once-too-scary-to-release-gpt-2-gets-squeezed-into-an-excel-spreadsheet/