Template argument deduction using SymbolDatabase#8720
Conversation
| MathLib::value num(arg->str()); | ||
| if (num.isFloat()) { | ||
| // MathLib::getSuffix doesn't work for floating point numbers | ||
| const char suffix = arg->str().back(); |
| if (it != parameterCountCache.cend()) | ||
| return it->second; | ||
| const DeductionCandidate parsed = parseDeductionCandidate(candidate); | ||
| const int count = parsed.typeParameters.empty() ? -1 : static_cast<int>(parsed.parameterShapes.size()); |
| // matching is not possible yet - the declaration may be in a base class - so | ||
| // consider all declarations with this name. | ||
| for (auto pos = range.first; pos != range.second; ++pos) { | ||
| if (supportedParameterCount(*pos->second) == static_cast<int>(instantiationArgs.size())) { |
| const TokenAndName* declaration = nullptr; | ||
| DeductionCandidate parsedDeclaration; | ||
| for (const TokenAndName* candidate : candidates) { | ||
| if (supportedParameterCount(*candidate) != static_cast<int>(instantiationArgs.size())) |
| // "T *": the argument must be a pointer and T is the pointee type | ||
| if (pointer < 1) | ||
| return DeducedType(); | ||
| constness &= ~(1U << pointer); |
|
|
||
| if (pointer > 2) | ||
| return DeducedType(); | ||
| if (constness >= (1U << (pointer + 1))) |
| case ValueType::UNKNOWN_INT: | ||
| // not deducible | ||
| return DeducedType(); | ||
| } |
| static void insertDeducedType(Token* tok, const DeducedType& deduced) | ||
| { | ||
| for (int level = deduced.pointer; level >= 1; --level) { | ||
| if (deduced.constness & (1U << level)) |
| std::vector<const Token*> declarationParams; | ||
| getFunctionArguments(candidate.nameToken(), declarationParams); | ||
|
|
||
| std::vector<bool> deducible(parsed.typeParameters.size(), false); |
| if (argRoots.size() != instantiationArgs.size()) | ||
| return qualification; | ||
| std::vector<DeducedType> deducedTypes(parsedDeclaration.typeParameters.size()); | ||
| std::vector<bool> deducedSet(parsedDeclaration.typeParameters.size(), false); |
|
So I ran some numbers comparing the time with valueflow disabled:
It seems to be about ~20-30% slower, which is much better than what it was before at ~80% slower doing full rebuilds. Partial rebuilds seem to really help a lot with this. Obviously since we are doing more instantiations than before it is going to be slower even as there may be room to improve this further. I think this is an acceptable slowdown and in the end I think this will still be faster than the approach in #8688 as we will have to always compute the valuetypes twice since they are seperate components. So I think this approach is ultimately better. @danmar @chrchr-github What are you thoughts on this approach? I can work on cleaning up this PR and fixing the CI failures if you think this is the better way to go. |
This creates a loop where we run the TemplateSimplifier -> varids/links/AST/SymbolDatabase/ValueTypes, so on the second round of
TemplateSimplifierwe can use type information from theSymbolDatabase. Not all the passes need to run withTemplateSimpliferso there is aSymbolDatabase::finalize().On a naive run, it would delete all the AST/SymbolDatabase information, but this can be kind of slow. So I added some incremental updates by tracking where new tokens are added(plus the function bodies around changed call sites), and then refactoring functions to work on token ranges, so there is now
TokenList::createAst(start, end)and in SymbolDatabase:addSymbolsForNewTokenRanges(),updateFunctionAndVariablePointers(), a range-limitedsetValueTypeInTokenList()andfindAllScopes(const Token* startToken, const Token* endToken, Scope* startScope). Also thecreateSymbolDatabaseFindAllScopesinternals were split into reusable per-scope/per-function helpers to support this.Now this only does incremental updates on function instantiation because its much simpler to do as it only adds a
Function, its scope and locals(and the only stale references in old code are the renamed call sites, whichupdateFunctionAndVariablePointers()re-resolves by name). Instantiating a class introduces new functions and types that could be resolved in other parts of the code. So for this case it does a full rebuild.Also the template alias simplifications requires a full build as well as it restructures existing tokens throughout the list, not just in new ranges. So the "unchanged tokens keep valid info" premise of the incremental update no longer holds.
We can probably address these in the future but will require a larger refactor. I also added a
--template-full-rebuildso we can debug any issue with the incremental updates.