Knowledge Augmented LLMs Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Augmentation & Enrichment