Open a web browser and go to
https://outlook.office.com and log in to your email
Select the "Hamburger" menu in the upper right
Select "Settings"
Select "Automatic replies"
Toggle the "Automatic replies" button
Enter your Out of Office Message and click "Save"