We want to use automated and distributed tests with the Visual Studio testing framework (not only MS Test).
Our automated build-/test-setup (on our recently upgraded on-premise TFS 2015) is the following:
1) We still using the old MS Test distributed execution.
2) We are tied to the old XAML build system for a while (since the build process is highly customized).
I've been read that recent
blog post.
Also, I have been tried the new distributed task execution on Azure VMs but I stopped for now due the lack of time to set-up the correct configuration. (As I understand the mentioned blog post, that is not yet supported anyway.)
From my understanding, the new distributed test capabilities are only available for the new scripted build system.
We really want to replace the MS-Test-only distributed test execution with a Visual Studio test framework execution.
It is annoying for us, that we still cannot use 3rd party test frameworks (NUnit, etc.) for distributed tests.
Before TFS 2015 came out, I was working on a C# project which tries to distribute tests in a similar fashion like the new TFS 2015 test task.
But we do not want to reinvent the wheel and I was quite happy as I read in the TFS 2015 release notes:
"VSTest Remote Task runs tests on remote machines in a distributed fashion by using test agents, and you can run either functional, unit tests or UI tests."
I stopped the working on our special implementation, since I had the hope that our project is obsolete.
Now I am worrying that assumption was wrong.
Now, I am pretty confused and got lots of questions. Hopefully someone can answer to them:
1. Is it possible the use the functions which are used by the task
RunDistributedTests on other places too?
2. That task is importing the modules "Microsoft.TeamFoundation.DistributedTask.Task.Common", "Microsoft.TeamFoundation.DistributedTask.Task.Internal", "Microsoft.TeamFoundation.DistributedTask.Task.DTA". Where is the code of that
imports located?
(I do not have lot of experience with Power Shell and did not found any DLL on my local developer machine.)
3. Are there any plans to make the new distributed facilities available in the old XAML builds?
4. Or are there plans to make new tasks available in the XAML builds? (I know XAML builds and new scripted builds are in different sub systems.)
There are some paths for the future for us:
a) We migrate to the new build system. This is not option for the near future due lack of human resources.
b) We further develop our own test distribution library. I am not sure, if that is feasible.
c) We wait for Microsoft is implementing something for us or maybe there is something still implemented by Microsoft?
Does anybody have suggestions? Every single advice will be helpful.