Depending on the size of your table this can be too expensive and result in downtime. Remember that deletes cost you the same as a write, so you’ll get throttled by your provisioned WCU. It would be much simpler and faster to just delete and recreate the table.
# this uses jq but basically we're just removing
If you really want to you can delete each item individually and you’re on the right track you just need to specify both the hash and range keys in your scan projection and delete command.
aws dynamodb scan \
--attributes-to-get $HASH_KEY $RANGE_KEY \
--table-name $TABLE_NAME --query "Items[*]" \
# use jq to get each item on its own line
| jq --compact-output '.' \
# replace newlines with null terminated so
# we can tell xargs to ignore special characters
| tr '\n' '\0' \
| xargs -0 -t -I keyItem \
# use the whole item as the key to delete (dynamo keys *are* dynamo items)
aws dynamodb delete-item --table-name $TABLE_NAME --key=keyItem
If you want to get super fancy you can use the describe-table call to fetch the hash and range key to populate $HASH_KEY and $RANGE_KEY but i’ll leave that as an exercise for you.