Encountered null while assembling a row with handleInvalid = `error`. Consider removing nulls from dataset or using handleInvalid = `keep` or `skip`.

The solution for this is noted below

Encountered null while assembling a row with handleInvalid = error. Consider removing nulls from dataset or using handleInvalid = keep or skip.

Solution

assembler.setHandleInvalid("skip").transform(df).show

Try other methods by searching on the site. That is if this doesn’t work