{"id":86,"date":"2024-02-28T00:40:01","date_gmt":"2024-02-28T00:40:01","guid":{"rendered":"https:\/\/caltechaia.org\/?page_id=86"},"modified":"2024-02-28T00:40:01","modified_gmt":"2024-02-28T00:40:01","slug":"what-is-ml-safety","status":"publish","type":"page","link":"https:\/\/caltechaia.org\/index.php\/what-is-ml-safety\/","title":{"rendered":"What is ML\u00a0Safety?"},"content":{"rendered":"\n<p>ML systems are rapidly increasing in size, are acquiring new capabilities, and are increasingly deployed in high-stakes settings. As with other powerful technologies, the safety of ML systems should be a leading research priority. This involves ensuring systems can withstand hazards (<strong>Robustness<\/strong>), identifying hazards (<strong>Monitoring<\/strong>), reducing inherent ML system hazards (<strong>Alignment<\/strong>), and reducing systemic hazards (<strong>Systemic Safety<\/strong>). Example problems and subtopics in these categories are listed below:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Robustness: Adversaries, Long Tails<\/li>\n\n\n\n<li>Monitoring: Anomalies, Interpretable Uncertainty, Transparency, Trojans, Emergent Behavior<\/li>\n\n\n\n<li>Alignment: Honesty, Power Aversion, Value Learning, Machine Ethics<\/li>\n\n\n\n<li>Systemic Safety: ML for Improved Epistemics, ML for Improved Cyberdefense, Cooperative AI<\/li>\n<\/ul>\n\n\n\n<p>You can learn more <strong>here<\/strong>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>ML systems are rapidly increasing in size, are acquiring new capabilities, and are increasingly deployed in high-stakes settings. As with other powerful technologies, the safety of ML systems should be a leading research priority. This involves ensuring systems can withstand hazards (Robustness), identifying hazards (Monitoring), reducing inherent ML system hazards (Alignment), and reducing systemic hazards [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"om_disable_all_campaigns":false,"footnotes":""},"class_list":["post-86","page","type-page","status-publish","hentry"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/caltechaia.org\/index.php\/wp-json\/wp\/v2\/pages\/86","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/caltechaia.org\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/caltechaia.org\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/caltechaia.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/caltechaia.org\/index.php\/wp-json\/wp\/v2\/comments?post=86"}],"version-history":[{"count":1,"href":"https:\/\/caltechaia.org\/index.php\/wp-json\/wp\/v2\/pages\/86\/revisions"}],"predecessor-version":[{"id":87,"href":"https:\/\/caltechaia.org\/index.php\/wp-json\/wp\/v2\/pages\/86\/revisions\/87"}],"wp:attachment":[{"href":"https:\/\/caltechaia.org\/index.php\/wp-json\/wp\/v2\/media?parent=86"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}