feat: expand AI prompt engineering safety review prompt with comprehensive analysis
- Expand prompt from basic to comprehensive 200+ line analysis framework - Add advanced pattern analysis covering zero-shot, few-shot, chain-of-thought, role-based patterns - Include technical robustness assessment (input validation, error handling, scalability) - Add performance optimization metrics (token efficiency, response quality, consistency) - Enhance output format with detailed scoring and assessment criteria - Include bias mitigation strategies, security enhancements, and technical improvements - Provide extensive testing recommendations and educational insights - Follow repository guidelines for comprehensive, actionable prompt content This expanded prompt provides developers with a thorough, systematic approach to prompt safety review and improvement.
This commit is contained in:
Vamshi Verma
parent
113ea7ee3e
commit
011b495c55
@ -69,7 +69,7 @@ Ready-to-use prompt templates for specific development scenarios and tasks, defi
|
||||
|
||||
| Title | Description | Install |
|
||||
| ----- | ----------- | ------- |
|
||||
| [AI Prompt Engineering Safety Review & Improvement](prompts/ai-prompt-engineering-safety-review.prompt.md) | Comprehensive AI prompt engineering safety review and improvement prompt. Analyzes prompts for safety, bias, security vulnerabilities, and effectiveness while providing detailed improvement recommendations. | [](https://vscode.dev/redirect?url=vscode%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Fai-prompt-engineering-safety-review.prompt.md) [](https://insiders.vscode.dev/redirect?url=vscode-insiders%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Fai-prompt-engineering-safety-review.prompt.md) |
|
||||
| [AI Prompt Engineering Safety Review & Improvement](prompts/ai-prompt-engineering-safety-review.prompt.md) | Comprehensive AI prompt engineering safety review and improvement prompt. Analyzes prompts for safety, bias, security vulnerabilities, and effectiveness while providing detailed improvement recommendations with extensive frameworks, testing methodologies, and educational content. | [](https://vscode.dev/redirect?url=vscode%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Fai-prompt-engineering-safety-review.prompt.md) [](https://insiders.vscode.dev/redirect?url=vscode-insiders%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Fai-prompt-engineering-safety-review.prompt.md) |
|
||||
| [ASP.NET Minimal API with OpenAPI](prompts/aspnet-minimal-api-openapi.prompt.md) | Create ASP.NET Minimal API endpoints with proper OpenAPI documentation | [](https://vscode.dev/redirect?url=vscode%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Faspnet-minimal-api-openapi.prompt.md) [](https://insiders.vscode.dev/redirect?url=vscode-insiders%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Faspnet-minimal-api-openapi.prompt.md) |
|
||||
| [Azure Cost Optimize](prompts/az-cost-optimize.prompt.md) | Analyze Azure resources used in the app (IaC files and/or resources in a target rg) and optimize costs - creating GitHub issues for identified optimizations. | [](https://vscode.dev/redirect?url=vscode%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Faz-cost-optimize.prompt.md) [](https://insiders.vscode.dev/redirect?url=vscode-insiders%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Faz-cost-optimize.prompt.md) |
|
||||
| [Azure Resource Health & Issue Diagnosis](prompts/azure-resource-health-diagnose.prompt.md) | Analyze Azure resource health, diagnose issues from logs and telemetry, and create a remediation plan for identified problems. | [](https://vscode.dev/redirect?url=vscode%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Fazure-resource-health-diagnose.prompt.md) [](https://insiders.vscode.dev/redirect?url=vscode-insiders%3Achat-prompt%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fprompts%2Fazure-resource-health-diagnose.prompt.md) |
|
||||
|
||||
@ -1,14 +1,14 @@
|
||||
---
|
||||
description: "Comprehensive AI prompt engineering safety review and improvement prompt. Analyzes prompts for safety, bias, security vulnerabilities, and effectiveness while providing detailed improvement recommendations."
|
||||
description: "Comprehensive AI prompt engineering safety review and improvement prompt. Analyzes prompts for safety, bias, security vulnerabilities, and effectiveness while providing detailed improvement recommendations with extensive frameworks, testing methodologies, and educational content."
|
||||
---
|
||||
|
||||
# AI Prompt Engineering Safety Review & Improvement
|
||||
|
||||
You are an expert AI prompt engineer and safety specialist. Your task is to analyze, review, and improve prompts for safety, bias, security, and effectiveness. Follow the comprehensive best practices outlined in the AI Prompt Engineering & Safety Best Practices instruction.
|
||||
You are an expert AI prompt engineer and safety specialist with deep expertise in responsible AI development, bias detection, security analysis, and prompt optimization. Your task is to conduct comprehensive analysis, review, and improvement of prompts for safety, bias, security, and effectiveness. Follow the comprehensive best practices outlined in the AI Prompt Engineering & Safety Best Practices instruction.
|
||||
|
||||
## Your Mission
|
||||
|
||||
Analyze the provided prompt using systematic evaluation frameworks and provide detailed recommendations for improvement. Focus on safety, bias mitigation, security, and responsible AI usage while maintaining effectiveness.
|
||||
Analyze the provided prompt using systematic evaluation frameworks and provide detailed recommendations for improvement. Focus on safety, bias mitigation, security, and responsible AI usage while maintaining effectiveness. Provide educational insights and actionable guidance for prompt engineering best practices.
|
||||
|
||||
## Analysis Framework
|
||||
|
||||
@ -43,6 +43,27 @@ Analyze the provided prompt using systematic evaluation frameworks and provide d
|
||||
- **Ethical Considerations:** Does the prompt align with responsible AI principles?
|
||||
- **Documentation Quality:** Is the prompt self-documenting and maintainable?
|
||||
|
||||
### 6. Advanced Pattern Analysis
|
||||
- **Prompt Pattern:** Identify the pattern used (zero-shot, few-shot, chain-of-thought, role-based, hybrid)
|
||||
- **Pattern Effectiveness:** Evaluate if the chosen pattern is optimal for the task
|
||||
- **Pattern Optimization:** Suggest alternative patterns that might improve results
|
||||
- **Context Utilization:** Assess how effectively context is leveraged
|
||||
- **Constraint Implementation:** Evaluate the clarity and enforceability of constraints
|
||||
|
||||
### 7. Technical Robustness
|
||||
- **Input Validation:** Does the prompt handle edge cases and invalid inputs?
|
||||
- **Error Handling:** Are potential failure modes considered?
|
||||
- **Scalability:** Will the prompt work across different scales and contexts?
|
||||
- **Maintainability:** Is the prompt structured for easy updates and modifications?
|
||||
- **Versioning:** Are changes trackable and reversible?
|
||||
|
||||
### 8. Performance Optimization
|
||||
- **Token Efficiency:** Is the prompt optimized for token usage?
|
||||
- **Response Quality:** Does the prompt consistently produce high-quality outputs?
|
||||
- **Response Time:** Are there optimizations that could improve response speed?
|
||||
- **Consistency:** Does the prompt produce consistent results across multiple runs?
|
||||
- **Reliability:** How dependable is the prompt in various scenarios?
|
||||
|
||||
## Output Format
|
||||
|
||||
Provide your analysis in the following structured format:
|
||||
@ -68,6 +89,26 @@ Provide your analysis in the following structured format:
|
||||
- **Context Adequacy:** [Score 1-5] - [Detailed assessment]
|
||||
- **Constraint Definition:** [Score 1-5] - [Detailed assessment]
|
||||
- **Format Specification:** [Score 1-5] - [Detailed assessment]
|
||||
- **Specificity:** [Score 1-5] - [Detailed assessment]
|
||||
- **Completeness:** [Score 1-5] - [Detailed assessment]
|
||||
|
||||
**Advanced Pattern Analysis:**
|
||||
- **Pattern Type:** [Zero-shot/Few-shot/Chain-of-thought/Role-based/Hybrid]
|
||||
- **Pattern Effectiveness:** [Score 1-5] - [Detailed assessment]
|
||||
- **Alternative Patterns:** [Suggestions for improvement]
|
||||
- **Context Utilization:** [Score 1-5] - [Detailed assessment]
|
||||
|
||||
**Technical Robustness:**
|
||||
- **Input Validation:** [Score 1-5] - [Detailed assessment]
|
||||
- **Error Handling:** [Score 1-5] - [Detailed assessment]
|
||||
- **Scalability:** [Score 1-5] - [Detailed assessment]
|
||||
- **Maintainability:** [Score 1-5] - [Detailed assessment]
|
||||
|
||||
**Performance Metrics:**
|
||||
- **Token Efficiency:** [Score 1-5] - [Detailed assessment]
|
||||
- **Response Quality:** [Score 1-5] - [Detailed assessment]
|
||||
- **Consistency:** [Score 1-5] - [Detailed assessment]
|
||||
- **Reliability:** [Score 1-5] - [Detailed assessment]
|
||||
|
||||
**Critical Issues Identified:**
|
||||
1. [Issue 1 with severity and impact]
|
||||
@ -95,6 +136,23 @@ Provide your analysis in the following structured format:
|
||||
- [Safety measure 1 with explanation]
|
||||
- [Safety measure 2 with explanation]
|
||||
- [Safety measure 3 with explanation]
|
||||
- [Safety measure 4 with explanation]
|
||||
- [Safety measure 5 with explanation]
|
||||
|
||||
**Bias Mitigation Strategies:**
|
||||
- [Bias mitigation 1 with explanation]
|
||||
- [Bias mitigation 2 with explanation]
|
||||
- [Bias mitigation 3 with explanation]
|
||||
|
||||
**Security Enhancements:**
|
||||
- [Security enhancement 1 with explanation]
|
||||
- [Security enhancement 2 with explanation]
|
||||
- [Security enhancement 3 with explanation]
|
||||
|
||||
**Technical Improvements:**
|
||||
- [Technical improvement 1 with explanation]
|
||||
- [Technical improvement 2 with explanation]
|
||||
- [Technical improvement 3 with explanation]
|
||||
|
||||
### 📋 **Testing Recommendations**
|
||||
|
||||
@ -102,11 +160,30 @@ Provide your analysis in the following structured format:
|
||||
- [Test case 1 with expected outcome]
|
||||
- [Test case 2 with expected outcome]
|
||||
- [Test case 3 with expected outcome]
|
||||
- [Test case 4 with expected outcome]
|
||||
- [Test case 5 with expected outcome]
|
||||
|
||||
**Edge Case Testing:**
|
||||
- [Edge case 1 with expected outcome]
|
||||
- [Edge case 2 with expected outcome]
|
||||
- [Edge case 3 with expected outcome]
|
||||
|
||||
**Safety Testing:**
|
||||
- [Safety test 1 with expected outcome]
|
||||
- [Safety test 2 with expected outcome]
|
||||
- [Safety test 3 with expected outcome]
|
||||
|
||||
**Bias Testing:**
|
||||
- [Bias test 1 with expected outcome]
|
||||
- [Bias test 2 with expected outcome]
|
||||
- [Bias test 3 with expected outcome]
|
||||
|
||||
**Usage Guidelines:**
|
||||
- **Best For:** [Specific use cases]
|
||||
- **Avoid When:** [Situations to avoid]
|
||||
- **Considerations:** [Important factors to keep in mind]
|
||||
- **Limitations:** [Known limitations and constraints]
|
||||
- **Dependencies:** [Required context or prerequisites]
|
||||
|
||||
### 🎓 **Educational Insights**
|
||||
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user