Create a question on a Lesson page that is linked to the gradebook.
Click the 'X' next to the question
The question will be removed from the Lesson page
Choose the Gradebook tool
The gradebook item is still available and unable to be removed.