problems with profiling column names with period in name in pyspark

[jamie256]

Description

Filing on behalf of report.

column names:
"model1.Category", "model1.input_temp"
in a dataframe named df:

collect_column_profile_views(df)

-> No column named "model1.Category" error

• I have reviewed the Guidelines for Contributing and the Code of Conduct.

[github-actions]

This issue is stale. Remove stale label or it will be closed next week.

[richard-rogers]

I wasn't able to work around this with backtick escapes in collect_column_profile_views(), but renaming the columns works: input_df.toDF(*(c.replace('.', '_') for c in input_df.columns)). We might want to maintain a map so we can restore the original column names.