Math tools and 12 bit resolution

Forum for discussing PicoScope version 6 (non-automotive version)
Post Reply
VincenzoV
Newbie
Posts: 0
Joined: Tue Sep 10, 2013 6:04 pm

Math tools and 12 bit resolution

Post by VincenzoV »

Hi all
I compute a simple formula: V*V/R with a Picoscope 3000. I'm using last Picoscope software on Windows 10.
It work fine setting 8 bit resolution, but with 12 bit resolution the result is completely wrong, about an order of magnitude.
Attachments
8bit.png
12bit.png

bennog
Advanced User
Advanced User
Posts: 71
Joined: Mon Nov 26, 2012 9:16 am
Location: Netherlands

Re: Math tools and 12 bit resolution

Post by bennog »

Do you have a .psdata file.

It looks like black and blue are both math channels.

Benno

VincenzoV
Newbie
Posts: 0
Joined: Tue Sep 10, 2013 6:04 pm

Re: Math tools and 12 bit resolution

Post by VincenzoV »

> Do you have a .psdata file
No. I will create a new one

> It looks like black and blue are both math channels.
Yes, both.
Black: B/27000 (27000 is a resistor value)
Blue: B*B/27000

Thanks

Vv

VincenzoV
Newbie
Posts: 0
Joined: Tue Sep 10, 2013 6:04 pm

Re: Math tools and 12 bit resolution

Post by VincenzoV »

Updated...
This problem born if you set 12 bit resolution AND X10 probe
No problems using 12 bit resolution and X1 probe
No problems using 8 bit resolution and X10 probe

Red and blue: measure
Black: math (B/27000)
Cyano: math (B*B/27000)
Lime: math (A*B/27000)

Thanks

Vv
Attachments
x10-probe-8bit.psdata
(5.05 MiB) Downloaded 18 times
x10-probe.psdata
(5.05 MiB) Downloaded 21 times
x1-probe.psdata
(2.18 MiB) Downloaded 17 times

Post Reply