[U-Boot] [PATCH V2 1/7] test/py: Implement pytest infrastructure

[Heiko Schocher]

Hello Stephen,

Am 07.12.2015 um 22:51 schrieb Stephen Warren:
> On 12/02/2015 11:47 PM, Heiko Schocher wrote:
>> Hello Stephen,
>>
>> Am 02.12.2015 um 23:18 schrieb Stephen Warren:
>>> This tool aims to test U-Boot by executing U-Boot shell commands using
>>> the
>>> console interface. A single top-level script exists to execute or attach
>>> to the U-Boot console, run the entire script of tests against it, and
>>> summarize the results. Advantages of this approach are:
>>>
>>> - Testing is performed in the same way a user or script would interact
>>>    with U-Boot; there can be no disconnect.
>>> - There is no need to write or embed test-related code into U-Boot
>>> itself.
>>>    It is asserted that writing test-related code in Python is simpler and
>>>    more flexible that writing it all in C.
>>> - It is reasonably simple to interact with U-Boot in this way.
>>>
>>> A few simple tests are provided as examples. Soon, we should convert as
>>> many as possible of the other tests in test/* and test/cmd_ut.c too.
>>>
>>> In the future, I hope to publish (out-of-tree) the hook scripts, relay
>>> control utilities, and udev rules I will use for my own HW setup.
>>>
>>> See README.md for more details!
>>>
>>> Signed-off-by: Stephen Warren <swarren at wwwdotorg.org>
>>> Signed-off-by: Stephen Warren <swarren at nvidia.com>
>>> ---
>>
>> Nice work!
>>
>> I am working on another python approach, not only good for testing
>> u-boot, also works with linux, or other console based tests, see:
>>
>> [1] tbot
>> https://github.com/hsdenx/tbot
>
> That looks nice too.

Thanks! Users welcome ;-)

> I assume the scope there is too large to aim at inclusion into the U-Boot source tree, since it also
> aims at Linux testing too?

Yes, tbot has a larger scope ... not only u-boot/linux, all what can
be tested with a console ... board states currently are u-boot and
linux yes, but I have no other task to test ... other states can be
hopefully easy added ... and one big benefit is, you do not need to
have the board in your hands ...

I hope to get more users/labs/boards which can be integrated
into some nightly build ... thats the reason why I add in patch comments
tbot results from time to time ...

bye,
Heiko
-- 
DENX Software Engineering GmbH,      Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany