Like much else, this idea wasn't my own. For all I know this could be how everyone else is already writing quizzes and I was just out of the loop. A coworker and I attended an NCTM workshop a couple years ago and went to a session on SBG. It was a great one because it was a district that uses it district wide and were explaining their system. A decent amount was similar to what we were already doing but they had a really great system for how they design assessments. (I wish I could credit who this came from but it was nearly 3 years ago at this point and I just have no idea)
Before, I don't think there was any rhyme or reason to what questions I included. I tried to cover a variety of different aspects of the skill and would then grade based on what I saw.
The suggestion was to create each skill with questions of increasing difficulty to make it easier to determine what the student does/does not understand. Each skill contains five questions ranging from the absolute basics needed for the skill to a challenge question that requires the student to apply the skill to something not explicitly covered in class. And what I found most helpful was that they said they begin by writing the middle question. So for each skill they think about what does basic proficiency looks likes and make that the middle question. Then from there it's easier to scale the skill up and down. I don't always stick to exactly five questions, but the idea did help me to write quizzes easier.
This one is a good example of what it looks like on one of my assessments:
First questions is on there to see if the student understands the idea of distance. If this question is not correct, then I know right away what the problem is and where to start. The third question is the basics of what I want them to be able to do. The fourth puts words in to see if they get scared. If they can do the 3rd but not the 4th I know the words threw them.