OK, so first we discussed the final things needed to make our SCDM bulletproof, then we spent some brainstorming time on each segment.
First issue is the stop word removal:
we are placing the stop words in a Collection, then using Java's vector removeAll method to remove them all from the function comments vector:
func.comments.removeAll(stopWords);
Next issue is the gcc preprocessing
Using a simple:
gcc -E -C file.c
The gcc -E option performs only preprocessing. The -C option leaves all comments intact. This creates an extremely large file. We now have lots of extra comments that are not ours (from each .h included, etc.), so we need to rehash this idea, and implement it as an option, to execute preprocessor commands. We may need to simply skip many of the generated preprocessor segments, this may be easy to do since they are labelled as they are inserted.
File directories
Needs to be bulletproof - it is not creating the new directories, and is file system dependent.
Integration
We have started integrating many of the methods, however there is excess code for directory structures manipulation. We will correct this next week.