In PROC TEXTMINE, which step in the text mining pipeline transforms raw text documents into a term-by-document matrix?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Here's the deal — b is correct because in PROC TEXTMINE, the PARSE statement is responsible for parsing raw text: it tokenizes documents into terms, performs stemming, removes stop words, and builds the term-by-document frequency matrix that serves as input for subsequent analyses. A (SVD) is a dimensionality reduction step applied after the term matrix is built.
Full explanation below image
Full Explanation
B is correct because in PROC TEXTMINE, the PARSE statement is responsible for parsing raw text: it tokenizes documents into terms, performs stemming, removes stop words, and builds the term-by-document frequency matrix that serves as input for subsequent analyses. A (SVD) is a dimensionality reduction step applied after the term matrix is built. C (SENTIMENT) scores documents after parsing. D (LDA) discovers topics from the term matrix after parsing.