Doctests don't run on nonexported `macro_rules!` macros

[inquisitivecrystal]

At present, doctests aren't run on macro_rules! macros that are not annotated with #[macro_export]. After #88019, it will become possible to fix this problem. However, doing so will cause tests to run that were skipped previously to run, which will likely cause test failures and may mess up people's CI. It might be helpful to provide some form of warning period first.

The relevant code is here:

rust/src/librustdoc/doctest.rs

Lines 1175 to 1184 in 5eacec9

	hir::ItemKind::Macro(ref macro_def) => {
	// FIXME(#88038): Non exported macros have historically not been tested,
	// but we really ought to start testing them.
	let def_id = item.def_id.to_def_id();
	if macro_def.macro_rules && !self.tcx.has_attr(def_id, sym::macro_export) {
	intravisit::walk_item(self, item);
	return;
	}
	item.ident.to_string()
	}

Fixing this issue technically just requires removing that special case. However, things are complicated by the fact that this will cause people's tests to suddenly fail. I'm not really sure how we should handle that. @jyn514, do you have any ideas?

[jyn514]

See also https://rust-lang.zulipchat.com/#narrow/stream/266220-rustdoc/topic/.E2.9C.94.20Doctests.20on.20private.20macros.

[jyn514]

I think we should just change this; it's no different than #66059 in that the code was already broken before and we just didn't happen to run it. If you're really worried we can do a crater run but I would honestly be ok with just landing this.

[jyn514]

@rustbot label +E-easy +E-mentor

[jyn514]

Looks like #88019 accidentally prevented these doctests from being run even if --document-private-items is passed :(

[m-ysk]

@rustbot claim