Question 1: Short answer
easyAI-checkedTokenizationWhat does the last line print?
import re
text = "Hello, world. Is this-- a test?"
result = re.split(r'([,.:;?_!"()\']|--|\s)', text)
result = [item.strip() for item in result if item.strip()]
print(len(result))