Evaluating AI Models with the ETHICS Dataset for Ethical Alignment

This project explores the application of the ETHICS dataset to assess
AI systems’ alignment with shared human values. The dataset cov-
ers a broad spectrum of ethical scenarios, including justice, well-being,
and commonsense morality. The primary objective is to investigate
the impact of various pre-processing techniques on enhancing the per-
formance of existing models, as well as to fine-tune Transformer-based
models specifically for this dataset. Additionally, pre-trained models
will be tested via APIs to compare their effectiveness against custom-
tuned models. The findings aim to offer valuable insights into both
the limitations and potential advancements of AI models in ethical
decision-making tasks.