nam-2pir

Untitled

May 16th, 2025
57
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.06 KB | None | 0 0
  1. use this scoring spec:
  2.  
  3. scoring_spec = [
  4. {
  5. "label": "Origin Authenticity",
  6. "question": "Does the response evaluate the origin and contact authenticity?",
  7. "weight": 0.5
  8. },
  9. {
  10. "label": "Link Quality",
  11. "question": "Does the response assess the quality of the link or URL?",
  12. "weight": 0.5
  13. },
  14. {
  15. "label": "Language Style",
  16. "question": "Does the response evaluate the language and content style?",
  17. "weight": 0.5
  18. },
  19. {
  20. "label": "Urgency Assessment",
  21. "question": "Does the response assess the call-to-action urgency?",
  22. "weight": 0.5
  23. },
  24. {
  25. "label": "Design Issues",
  26. "question": "Does the response identify the design and presentation issues?",
  27. "weight": 0.5
  28. },
  29. {
  30. "label": "Too-Good-To-Be-True",
  31. "question": "Does the response evaluate the too-good-to-be-true claims?",
  32. "weight": 0.5
  33. },
  34. {
  35. "label": "Payment Irregularities",
  36. "question": "Does the response identify the Payment and Financial Irregularities?",
  37. "weight": 0.5
  38. },
  39. {
  40. "label": "Charity Exploitation",
  41. "question": "Does the response assess the Charity or Crisis Exploitation?",
  42. "weight": 0.5
  43. },
  44. {
  45. "label": "Tech Support Scams",
  46. "question": "Does the response identify the Tech Support or Fake Security Alerts?",
  47. "weight": 0.5
  48. },
  49. {
  50. "label": "Trust Signal Misuse",
  51. "question": "Does the response evaluate the misuse of trust signals?",
  52. "weight": 0.5
  53. },
  54. {
  55. "label": "Rating Explanation",
  56. "question": "Does the response provide clear and relevant notes explaining why each rating was given?",
  57. "weight": 0.5
  58. },
  59. {
  60. "label": "Abusive Language",
  61. "question": "Does the response avoid using abusive or inappropriate language?",
  62. "weight": 0.1
  63. },
  64. {
  65. "label": "Formatting Consistency",
  66. "question": "Is the response formatted consistently and easy to read?",
  67. "weight": 0.1
  68. }
  69. ]
Advertisement
Add Comment
Please, Sign In to add comment