bit-tech.net

Go Back   bit-tech.net Forums > bit-tech.net > Article Discussion

Reply
 
Thread Tools
Old 12th Oct 2005, 14:16   #1
Tim S
I Mod, Therefore I Own
 
Tim S's Avatar
 
Join Date: Nov 2001
Location: London
Posts: 18,879
Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.
Q.A. Gone M.I.A.

http://www.bit-tech.net/columns/2005...one_mia/1.html

__________________
My words don't necessarily reflect those of my employer.
Tim S is offline   Reply With Quote
Old 12th Oct 2005, 14:29   #2
Nath
Your appeal has already been filed.
 
Nath's Avatar
 
Join Date: Dec 2003
Location: UK
Posts: 2,409
Nath has yet to learn the way of the Dremel
It's good that writers are taking these sorts of issues into account when deciding how and when to publish articles, and as said in the column it should hopefully lead to a better, and more informative, set of information.
Nath is offline   Reply With Quote
Old 12th Oct 2005, 15:11   #3
Da Dego
Brett Thomas
 
Da Dego's Avatar
 
Join Date: Aug 2004
Location: Cleveland, OH USA
Posts: 3,913
Da Dego has yet to learn the way of the Dremel
As far as I'm concerned, I don't need a review long before the product ships. An advance warning, maybe...but I want my review to be accurate. After all, it's not like I can buy it before it hits retail anyways.

So, I'm in agreement. I'd rather it be right and prompt than rushed and early.
__________________
"Frankly that seems overkill. iluvtrees2 arguing with spec is the intellectual equivalent of a bunny rabbit taking on a pissed-off lion." - Nexxo
Da Dego is offline   Reply With Quote
Old 12th Oct 2005, 15:13   #4
[sinz]
69 Dude!!
 
Join Date: Sep 2005
Posts: 69
[sinz] has yet to learn the way of the Dremel
This sort of raises an interesting question. While you want to be right and want to give a review that accurately portrays the product in it's retail state, what does it say about companies who send out these unstable early samples? One would think that they want their product shown in the best possible light, and thus would not send faulty versions to the people who are likely to scrutinize them the most. If they're willing to send out something representative of their work that ends up being sub-par, I'm not sure I want to be purchasing anything from those companies anyway. It's quite a black mark on a company in my book if they don't sufficiently test their products before putting them on the chopping block for review. While I'm sure they do testing to some extent, the software tests you described aren't exactly that difficult to do, so I'm surprised that these manufacturers don't run similiar stress tests and find these faults before the samples get to you.

While I'm glad you don't want to publish reviews that are not representative of the end product, I still hope that you mention the issues you had with samples and whether or not, and how well, they have been resolved in the retail version. On the one hand, publishing a review of an unfinished product shows the manufacturer in a unjustly negative fashion. On the other, not discussing issues with samples and the lack of Q.A. may leave a better impression than is deserved.

I think this is actually a great way to go about things. Too often I've read a review which concludes with a statement saying that the product is a sample and the retail version may vary or issues may be resolved. It's almost as if there was no purpose in reading it at all.

Keep up the good work guys.
[sinz] is offline   Reply With Quote
Old 12th Oct 2005, 15:29   #5
yodasarmpit
No longer the other Brett.
 
yodasarmpit's Avatar
 
Join Date: May 2002
Location: West Lothian , Scotland
Posts: 10,663
yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.yodasarmpit is definitely a rep cheat.
Like you say a review is worthless if doesn't represent the final product, so samples and early release board reviews, although hinting at the final release, won't offer an opinion worth basing a purchase decision on.
Good to see that you will only publish an accurate review of a final release piece of kit.
__________________
The Rt. Hon. Alexander Boris de Pfeffel Johnson - "Ping Pong is coming home"
yodasarmpit is offline   Reply With Quote
Old 12th Oct 2005, 15:40   #6
hitman012
Super Moderator
Moderator
 
Join Date: May 2005
Location: London, UK
Posts: 4,877
hitman012 has yet to learn the way of the Dremelhitman012 has yet to learn the way of the Dremelhitman012 has yet to learn the way of the Dremel
Good for you guys - it's good to see that you're ever-striving to get reviews which are representative of what the users will experience
__________________
"Nothing is more practical than a good theory"
- Kurt Lewin
hitman012 is offline   Reply With Quote
Old 12th Oct 2005, 15:49   #7
Glider
/dev/null
 
Glider's Avatar
 
Join Date: Aug 2005
Location: Belgium
Posts: 4,173
Glider is definitely a rep cheat.Glider is definitely a rep cheat.Glider is definitely a rep cheat.Glider is definitely a rep cheat.Glider is definitely a rep cheat.Glider is definitely a rep cheat.Glider is definitely a rep cheat.Glider is definitely a rep cheat.Glider is definitely a rep cheat.Glider is definitely a rep cheat.Glider is definitely a rep cheat.
I like a good quality review over a early one all the times, but...

I do want an early preview of what manufacurers are striving for. That doesn't need to be a torture test or a benchmark, but more like: Board X sports these features: 999 Sata ports, 18 channel sound... :d
That doesn't have to be an in depth review, but more of a features litst. And if, later on, the final retail product is check out, then I don't mind reading 5-15 pages of testing...
__________________
There Are 10 Types Of People, Those Who Know Binary and Those Who Don't
Glider is offline   Reply With Quote
Old 12th Oct 2005, 15:54   #8
Jordanis3r
Jigsaw Master
 
Jordanis3r's Avatar
 
Join Date: Jan 2002
Location: London
Posts: 624
Jordanis3r has yet to learn the way of the Dremel
retail perspectives please - it is nice to have a peek at up and coming hardware sometimes, but not to the exclusion of having a prompt retail review, as they are more important to me - ie something that I may actually be willing to part with my hard earned cash ...

with pre release parts - I think it is unfair to expect them to work first time and be super stable - tbh its all in the process of maturing products, by sending them out as beta or pre-rel products so they can get outside feedback to help improve the product in question...
__________________
As the hours get longer .... the coffee gets stronger
Jordanis3r is offline   Reply With Quote
Old 12th Oct 2005, 16:05   #9
Bindibadgi
I Mod, Therefore I Own
 
Join Date: Mar 2001
Posts: 34,814
Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.Bindibadgi is definitely a rep cheat.
If you want to see pre-release stuff usually technological preview will be supplied by us or other sites. If you want to see what a board is to offer the best thing todo is read a manufacturer site that lists its features. If you then want to know if it's any good or not then you look for a review
They should do internal quality checks not get free and unstandardised stability tests from other people imo.
Bindibadgi is offline   Reply With Quote
Old 12th Oct 2005, 16:11   #10
RotoSequence
Lazy Lurker
 
RotoSequence's Avatar
 
Join Date: Jan 2004
Location: 'States
Posts: 4,588
RotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on you
Its starting to feel like the companies are getting review sites to provide the initial hype behind a future product release, and designing them to just WORK so that they can look good before launch. When you get unstable hardware, I wouldnt post a full review, not in the slightest. However, a preview would be something I would be interested in. If a motherboard shows early potential, A preview that talks about some of what this board appears to be capable of would be good, and a few pictures of the board in its retail design.

The more you say about it in the preview, the more the company will know how to make it better, causing them, and us, to win out in the end.
__________________
Technology Schmecnology
RotoSequence is offline   Reply With Quote
Old 12th Oct 2005, 16:15   #11
Tim S
I Mod, Therefore I Own
 
Tim S's Avatar
 
Join Date: Nov 2001
Location: London
Posts: 18,879
Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.
There's some good points made here so far. If we were to do more 'previews' with early products how do you feel they should be presented? In the hardware section or as a piece of news (i.e. a single page look at a board in a bit more depth than the recent pictorial of the DFI SLI-DR Expert)?

Or part way to a full review, just with early products?
__________________
My words don't necessarily reflect those of my employer.
Tim S is offline   Reply With Quote
Old 12th Oct 2005, 16:22   #12
RotoSequence
Lazy Lurker
 
RotoSequence's Avatar
 
Join Date: Jan 2004
Location: 'States
Posts: 4,588
RotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on you
That is the million dollar question, isnt it? Theres no reason to provide the depth present in a full motherboard review; things can change quite quickly. However, a one or two page preview with a couple of significant photos, commentary on layout and general board design and benchmark potential with some tables and minimal analysis would be just fine. I like looking at pictures, so the best way to tell us about it is to show us the board and the results as they stand.

As for the stability problem, you can always leave a note that the board is not in its retail release form, has potential and will be coming out in the future, or if its crap on a stick, leave it at that and never bother with the board again
__________________
Technology Schmecnology
RotoSequence is offline   Reply With Quote
Old 12th Oct 2005, 16:23   #13
MrWillyWonka
Chocolate computers galore!
Moderator
 
MrWillyWonka's Avatar
 
Join Date: Jul 2004
Location: Southampton, Hants
Posts: 5,892
MrWillyWonka has yet to learn the way of the DremelMrWillyWonka has yet to learn the way of the DremelMrWillyWonka has yet to learn the way of the Dremel
Can I ask, when you recieve products from manufacturers for reviewing, would you be biased to them on occasions? Because I remember reading a review where you couldn't compare this product with others from other manufacturers on manufacturers orders.
MrWillyWonka is offline   Reply With Quote
Old 12th Oct 2005, 16:31   #14
Tim S
I Mod, Therefore I Own
 
Tim S's Avatar
 
Join Date: Nov 2001
Location: London
Posts: 18,879
Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.Tim S is definitely a rep cheat.
Quote:
Originally Posted by MrWillyWonka
Can I ask, when you recieve products from manufacturers for reviewing, would you be biased to them on occasions? Because I remember reading a review where you couldn't compare this product with others from other manufacturers on manufacturers orders.
That was CrossFire. There was no point in showing that a 7800 GT/GTX outpaced X850 CrossFire anyway, because everyone already knows that. We can write that in the text anyway.

And no, we attempt to give a well-informed and fair account of our experiences with said product. The problem with the review today was that I personally didn't think we'd given said company a good enough chance to make things right before it is anywhere near ready for retail, which is why you don't see the product review today.

In short, the board that we were going to share our thoughts about today (which we'll not name, because this happens a lot) was and is woeful in its current state. Writing a review on something that clearly needs to change before you will be able to buy it seems a rather pointless exercise to me & Rich.
__________________
My words don't necessarily reflect those of my employer.
Tim S is offline   Reply With Quote
Old 12th Oct 2005, 16:38   #15
stephen2002
Multimodder
 
Join Date: Sep 2003
Posts: 183
stephen2002 has yet to learn the way of the Dremel
If it is an unstable part then it isn't finished. I agree with the column, don't bother to review it unless it is ready to go.

I also agree with some of the posts here, I don't mind reading shorter pre-release news blurbs giving a listing of features and some quick preformance numbers, along with the note that this is a pre-production model and is totally unstable.
stephen2002 is offline   Reply With Quote
Old 12th Oct 2005, 16:45   #16
RotoSequence
Lazy Lurker
 
RotoSequence's Avatar
 
Join Date: Jan 2004
Location: 'States
Posts: 4,588
RotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on you
Quote:
Originally Posted by stephen2002
If it is an unstable part then it isn't finished. I agree with the column, don't bother to review it unless it is ready to go.

I also agree with some of the posts here, I don't mind reading shorter pre-release news blurbs giving a listing of features and some quick preformance numbers, along with the note that this is a pre-production model and is totally unstable.
Thats exactly what I think. You could always release a revised version of the review, that gives quick reference numbers and some good pictures, say its unstable and not in final production form, and leave it at that; that way, you get an initial preview, help out the company in understanding that its not worth giving a full preview of but they have somewhere to go, and give us something to get excited about
__________________
Technology Schmecnology
RotoSequence is offline   Reply With Quote
Old 12th Oct 2005, 16:49   #17
3.5SE
Multimodder
 
Join Date: Nov 2003
Location: NY
Posts: 88
3.5SE has yet to learn the way of the Dremel
I recently had my new Seasonic S12-600 power supply fail after a week of use. From what I understand a number of others had similar experiences with new Seasonic PSU's. I'm hoping the one I get as a replacement is up to the usual Seasonic standards.
__________________
A8N SLI Prem., X2 3800+, 2GB Corsair PC3200, XFX 7800 GT, Lian Li PCV-2000B Case, Antec True Blue 480watt PSU sleeved, 74 GB WD Raptor HD, 160 GB Maxtor HD, Pioneer A09 DVD Burner, Cendyne 106S Slot Load DVD Drive
3.5SE is offline   Reply With Quote
Old 12th Oct 2005, 16:50   #18
RotoSequence
Lazy Lurker
 
RotoSequence's Avatar
 
Join Date: Jan 2004
Location: 'States
Posts: 4,588
RotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on youRotoSequence - may the hammer of Bindi be bestowed on you
Quote:
Originally Posted by 3.5SE
I recently had my new Seasonic S12-600 power supply fail after a week of use. From what I understand a number of others had similar experiences with new Seasonic PSU's. I'm hoping the one I get as a replacement is up to the usual Seasonic standards.
I think you posted in the wrong thread
__________________
Technology Schmecnology
RotoSequence is offline   Reply With Quote
Old 12th Oct 2005, 16:52   #19
eddie_dane
Used to mod pc's now I mod houses
 
eddie_dane's Avatar
 
Join Date: Jan 2002
Location: South Cackalaki, US
Posts: 5,538
eddie_dane should be considered for presidenteddie_dane should be considered for presidenteddie_dane should be considered for presidenteddie_dane should be considered for presidenteddie_dane should be considered for presidenteddie_dane should be considered for presidenteddie_dane should be considered for presidenteddie_dane should be considered for presidenteddie_dane should be considered for presidenteddie_dane should be considered for presidenteddie_dane should be considered for president
"overclocked and unstable" should be used to describe the bit-tech staff not the products we review.
__________________
<Linear> "poor drainage is ruining my marriage".
<My Wife> "I know everything, which is why you're in trouble all the time."
<KNA - aka my hero>Chris, I'm not in your signature file.. can you rectify this anomaly please.
<specofdust>More later, I have to go do something forbidden now
shutterdoggy.com
eddie_dane is offline   Reply With Quote
Old 12th Oct 2005, 17:19   #20
Da Dego
Brett Thomas
 
Da Dego's Avatar
 
Join Date: Aug 2004
Location: Cleveland, OH USA
Posts: 3,913
Da Dego has yet to learn the way of the Dremel
Quote:
Originally Posted by eddie_dane
"overclocked and unstable" should be used to describe the bit-tech staff not the products we review.
So true, so true.
__________________
"Frankly that seems overkill. iluvtrees2 arguing with spec is the intellectual equivalent of a bunny rabbit taking on a pissed-off lion." - Nexxo
Da Dego is offline   Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 01:31.
Powered by: vBulletin Version 3
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.